-- Logs begin at Wed 2022-08-10 11:49:06 UTC, end at Wed 2022-08-10 12:49:21 UTC. -- Aug 10 12:22:57.654728 dv-cinder-852261-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 12:22:57.663488 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 12:22:57 2022] *** Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: nodename: dv-cinder-852261-3-iscsi Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: machine: x86_64 Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: clock source: unix Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: pcre jit disabled Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: detected number of CPU cores: 4 Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: current working directory: / Aug 10 12:22:57.665462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: detected binary path: /usr/bin/uwsgi-core Aug 10 12:22:57.666153 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: your processes number limit is 47680 Aug 10 12:22:57.666153 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: your memory page size is 4096 bytes Aug 10 12:22:57.666153 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: detected max file descriptor number: 2048 Aug 10 12:22:57.666153 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: lock engine: pthread robust mutexes Aug 10 12:22:57.666153 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: thunder lock: enabled Aug 10 12:22:57.666153 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 12:22:57.666153 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 12:22:57.705014 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: Python main interpreter initialized at 0x558d313509c0 Aug 10 12:22:57.705014 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: python threads support enabled Aug 10 12:22:57.705014 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: your server socket listen backlog is limited to 100 connections Aug 10 12:22:57.705014 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: your mercy for graceful operations on workers is 90 seconds Aug 10 12:22:57.705386 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 12:22:57.705462 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: *** Operational MODE: preforking *** Aug 10 12:22:57.705698 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: *** uWSGI is running in multiple interpreter mode *** Aug 10 12:22:57.705698 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: spawned uWSGI master process (pid: 103036) Aug 10 12:22:57.705873 dv-cinder-852261-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 12:22:57.706409 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: spawned uWSGI worker 1 (pid: 103037, cores: 1) Aug 10 12:22:57.706754 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: spawned uWSGI worker 2 (pid: 103038, cores: 1) Aug 10 12:22:57.709323 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 12:22:58.362503 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 12:22:58.367380 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 12:22:59.433292 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:22:59.433292 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: from cryptography.utils import int_from_bytes Aug 10 12:22:59.433913 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:22:59.433913 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: from cryptography.utils import int_from_bytes Aug 10 12:22:59.436701 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:22:59.436701 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: from cryptography.utils import int_from_bytes Aug 10 12:22:59.437127 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:22:59.437127 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: from cryptography.utils import int_from_bytes Aug 10 12:23:01.912589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 12:23:01.913121 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 12:23:01.913377 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 12:23:01.913734 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 12:23:01.913987 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 12:23:01.914366 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.914684 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.915019 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.915308 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.915629 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.915933 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.916254 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.916566 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.916885 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.917141 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.917455 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 12:23:01.917852 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.917944 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 12:23:01.918025 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852261-3-iscsi {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.918103 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.918231 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 12:23:01.918367 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.918594 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 12:23:01.918682 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.918853 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 12:23:01.918970 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.919244 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.919332 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.919566 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.919664 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.919866 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.919968 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.920194 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.920353 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.920524 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.920794 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.920911 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.921098 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.921199 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.921430 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.921533 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.921765 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.921898 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.922034 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.922120 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.922362 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.922461 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.922669 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.922768 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852261-3-iscsi {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.922971 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.923060 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.923275 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.923368 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.923607 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.923706 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.923926 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.924009 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852261-3-iscsi {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.924232 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.924401 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.924563 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.924647 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.924876 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.924970 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.925286 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.925415 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.925616 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.925733 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.925920 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.926041 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.926229 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.926354 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.926554 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.926693 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.926858 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.927008 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.927175 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.927320 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.927487 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.927643 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.927797 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.927955 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.928116 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.928280 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.928414 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.928591 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.928687 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.928984 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852261-3-iscsi {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.929073 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.929353 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.929457 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.929612 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.929713 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.929913 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.930011 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.930156 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.930329 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.930457 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.930642 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.930770 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.930952 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.931084 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.931276 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.931399 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.931598 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.931684 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.931881 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.931981 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.932190 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.932281 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.932504 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.932594 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.932805 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.932945 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.933110 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.933197 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.933438 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.933543 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.933741 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.933836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.934040 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.934128 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.934340 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.934443 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.934640 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.934738 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.934938 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.935024 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.935189 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.935283 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.935500 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.935586 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.935823 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.935909 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.936135 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.936232 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.936448 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.936534 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.936700 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.936835 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.936936 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.937081 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.937260 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.937406 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.937600 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.937739 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.937910 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.938048 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.938218 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.938351 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.938525 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.938662 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.938832 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.938976 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.939656 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.939796 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.939970 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.940101 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.940280 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.940379 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.940588 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.940683 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.940907 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.941017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.941226 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.941359 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.941541 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.941626 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.941837 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.941939 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.942140 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.942248 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.942452 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.942550 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.942748 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.942836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.943048 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.943136 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.943351 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.943437 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.943645 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.943741 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.943942 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.944030 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.944242 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.944328 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.944541 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.944628 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.944840 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.944927 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.945139 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.945227 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.945462 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.945551 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.945762 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.945856 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.946065 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.946209 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.946371 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.946460 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.946675 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.946770 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.946989 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.947089 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.947286 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.947373 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.947583 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.947677 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.947882 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.947977 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.948177 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.948268 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.948486 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.948578 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.948783 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.948877 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.949080 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.949174 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.949420 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.949522 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.949722 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.949885 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.950037 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.950183 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.950329 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.950423 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.950628 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.950722 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.950925 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.951011 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.951232 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.951318 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.951523 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.951620 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.951822 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.951915 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.952132 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.952237 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.952428 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.952554 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.952726 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.952813 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.953019 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.953105 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.953340 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.953454 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.953642 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.953729 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.953941 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.954026 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.954237 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.954330 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.954535 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.954621 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.955407 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.955505 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.955723 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.955812 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.956038 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.956123 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.956340 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.956481 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.956631 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.956768 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.956926 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.957070 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.957238 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.957422 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.957566 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.957703 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.957875 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.958013 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.958186 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.958341 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.958477 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.958612 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.958785 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.958875 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.959094 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.959217 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.959403 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.959532 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.959711 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.959839 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.960016 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.960149 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.960324 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.960468 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.960625 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.960776 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.960945 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.961083 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.961286 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.961414 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.961598 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.961726 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.961910 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.962042 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.962218 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.962366 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.962538 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:23:01.962660 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.962876 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.962964 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.963210 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.963295 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.963556 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.963641 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.963871 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.963965 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.964194 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.964286 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.964507 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.964601 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.964812 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.964908 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.965133 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.965218 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.965480 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.965569 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.965788 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.965882 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.966108 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.966195 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.966420 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.966519 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.966726 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.966811 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.967033 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.967128 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.967339 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.967438 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.967655 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.967763 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.967979 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.968071 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.968283 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.968377 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.968595 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.968682 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.968900 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.968998 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.969204 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.969345 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.969536 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.969623 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.969839 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.969935 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.970143 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.970240 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.970503 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.970603 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.970813 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.970899 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.971125 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.971212 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.971434 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.971521 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.971746 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.971845 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.972052 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.972141 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.972358 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.972444 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.972663 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.972802 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.972964 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.973059 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.973289 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.973388 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.973589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.973675 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.973895 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.973983 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.974193 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.974278 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.974507 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.974602 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.974821 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.974914 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.975122 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.975208 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.975439 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.975535 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.975738 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.975831 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.976045 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.976131 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.976352 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.976494 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.976922 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.977011 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.977224 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.977360 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.977554 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.977655 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.977860 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.977948 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.978159 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.978253 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.978470 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.978556 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.978773 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.978903 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.979072 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.979166 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.979383 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.979476 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.979681 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.979773 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.979981 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.980067 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.980289 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.980376 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.980594 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.980691 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.980897 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.980996 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.981202 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.981309 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.981535 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.981623 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.981857 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.981990 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.982164 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.982264 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.982470 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.982567 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.982787 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.982901 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.983103 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.983190 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.983403 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.983496 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.983720 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.983816 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.984031 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.984116 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.984338 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.984431 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.984635 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.984729 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.984940 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.985027 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.985239 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.985397 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.985563 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.985659 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.985861 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.985948 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.986193 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.986279 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.986489 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.986620 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.986790 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.986884 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.987088 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.987176 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.987384 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.987479 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.987679 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.987777 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.987994 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.988082 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.988296 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.988385 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.988592 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.988685 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.988888 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.988988 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.989184 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.989333 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.989592 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.989686 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.989901 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.989996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.990216 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.990312 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.990524 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.990611 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.990834 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.990929 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.991140 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.991228 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.991444 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.991529 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.991748 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.991843 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.992049 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.992134 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.992355 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.992441 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.992656 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.992749 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.992960 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.993046 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.993300 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.993433 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.993600 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.993689 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.993904 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.993990 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.994205 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.994299 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.994507 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.994594 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.994810 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.994897 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.995119 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.995205 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.995418 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.995506 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.995727 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.995813 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.996056 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.996150 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.996379 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.996467 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.996687 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.996775 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.997002 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.997148 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.997333 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.997434 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.997644 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.997730 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.997946 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.998042 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.998249 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.998348 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.998550 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.998698 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.998854 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.998955 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.999165 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.999252 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.999466 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.999559 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.999774 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:01.999868 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.000075 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.000169 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.000387 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.000481 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.000688 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.000777 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.000996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.001089 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.001309 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.001398 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.002154 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.002250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.002474 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.002560 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.002797 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.002892 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.003100 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.003196 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.003404 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.003498 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.003716 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.003814 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.004024 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.004118 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.004325 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.004410 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.004629 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.004723 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.004926 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.005012 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.005223 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.005340 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.005563 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.005658 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.005873 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.005962 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.006178 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.006264 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.006482 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.006577 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.006781 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.006868 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.007089 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.007212 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.007388 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.007482 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.007686 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.007779 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.007986 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.008072 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.008288 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.008377 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.008601 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.008687 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.008904 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.008990 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.009219 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.009357 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.009554 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.009654 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.009854 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.009945 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.010152 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.010240 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.010457 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.010550 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.010759 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.010843 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.011055 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.011144 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.011350 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.011436 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.011646 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.011731 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.011956 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.012050 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.012274 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.012368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.012571 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.012671 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.012876 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.012961 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.013184 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.013290 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.013512 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.013618 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.013821 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.013908 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.014127 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.014213 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.014430 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.014531 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.014744 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.014831 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.015050 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.015153 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.015351 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.015450 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.015655 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.015752 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.015956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.016043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.016259 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.016398 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.016563 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.016647 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.016869 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.016955 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.017190 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.017857 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.018056 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.018144 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.018357 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.018444 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.018655 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.018752 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.018957 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.019051 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.019266 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.019354 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.019596 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.019825 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.019912 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.020152 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.020246 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.020462 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.020550 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.020776 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.020900 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.021090 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.021178 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.021427 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.021518 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.021740 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.021825 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.022055 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.022151 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.022365 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.022461 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.022674 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.022774 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.022980 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.023067 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.023280 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.023374 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.023578 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.023671 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.023881 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.023980 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.024177 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.024275 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.024475 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.024574 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.024771 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.025047 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.025141 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.025381 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.025474 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.025682 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.025769 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.025981 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.026079 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.026277 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.026372 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.026583 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.026670 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.026879 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.027014 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.027183 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.027270 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.027480 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.027603 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.027792 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.027914 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.028094 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.028227 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.028389 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.028533 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.028683 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.028839 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.028976 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.029153 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.029330 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.029484 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.029635 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.029792 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.029967 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.030097 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.030287 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.030407 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.030620 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.030715 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.030919 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.031051 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.031216 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.031351 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.031525 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.031625 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.031824 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.031918 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.032123 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.032212 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.032420 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.032519 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.032726 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.032835 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.033057 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.033152 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.033376 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.033481 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.033683 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.033778 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.033992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.034083 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.034296 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.034385 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.034600 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.034686 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.034895 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.034988 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.035198 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.035294 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.035495 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.035581 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.035800 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.035887 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.036102 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.036189 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.036398 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.036486 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.036693 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.036787 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.036996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.037120 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.037315 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.037404 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.037614 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.037716 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.037916 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.038003 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.038211 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.038298 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.038518 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.038613 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.038814 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.038900 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.039110 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.039204 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.039404 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.039499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.039704 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.039790 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.040004 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.040091 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.040299 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.040397 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.040613 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.040700 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.040914 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.041000 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.041210 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.041350 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.041532 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.041632 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.041834 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.041921 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.042130 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.042217 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.042426 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.042520 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.042728 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.042815 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.043034 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.043141 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.043338 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.043430 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.043632 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.043728 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.043938 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.044026 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.044234 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.044321 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.044531 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.044626 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.044827 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.044914 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.045127 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.045213 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.045447 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.045546 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.045746 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.045851 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.046043 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.046131 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.046337 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.046435 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.046630 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.046717 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.046942 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.047037 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.047244 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.047339 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.047536 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.047667 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.047834 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.047929 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.048127 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.048216 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.048481 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.048570 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.048779 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.048865 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.049090 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.049177 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.049421 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.049511 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.049728 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.049814 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.050033 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.050122 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.050333 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.050425 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.050635 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.050729 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.050940 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.051028 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.051235 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.051321 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.051536 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.051629 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.051838 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.051931 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.052147 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.052235 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.052447 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.052542 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.052747 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.052843 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.053050 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.053136 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.053379 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.053549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.053685 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.053770 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.054005 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.054092 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.054320 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.054416 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.054634 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.054729 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.054933 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.055020 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.055237 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.055325 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.055542 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.055628 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.055846 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.055947 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.056148 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.056245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.056450 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.056536 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.056752 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.056844 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.057058 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.057153 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.057389 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.057488 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.057693 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.057778 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.057995 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.058083 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.058294 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.058390 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.058599 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.058694 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.058902 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.058989 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.059199 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.059285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.059515 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.059610 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.059821 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.059907 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.060120 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.060206 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.060425 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.060520 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.060726 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.060813 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.061031 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.061116 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.061349 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.061450 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.061663 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.061771 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.061974 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.062081 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.062287 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.062375 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.062602 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.062689 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.062912 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.063000 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.063223 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.063311 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.063530 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.063626 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.063852 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.063939 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.064675 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.064769 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.064997 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.065082 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.065350 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.065441 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.065667 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.065757 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.065981 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.066067 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.066277 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.066414 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.066575 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.066662 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.066879 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.066965 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.067184 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.067329 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.067483 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.067611 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.067784 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.067922 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.068078 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.068222 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.068394 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.068529 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.068694 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.068839 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.069006 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.069151 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.069436 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.069536 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.069745 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.069834 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.070044 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.070139 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.070449 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.070536 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.070755 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.070849 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.071058 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.071150 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.071371 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.071457 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.071685 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.071771 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.071989 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.072077 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.072285 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.072370 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.072590 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.072684 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.072893 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.072981 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.073197 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.073302 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.073526 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.073630 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.073831 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.073917 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.074138 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.074231 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.074434 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.074529 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.074746 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.074846 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.075056 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.075153 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.075361 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.075448 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.075672 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.075855 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.076073 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.076160 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.076385 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.076480 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.076687 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.076789 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.077001 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.077088 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.077341 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.077434 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.077643 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.077752 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.077940 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.078027 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.078244 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.078339 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.078542 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.078630 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.078839 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.078934 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.079155 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.079242 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.079456 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.079544 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.080303 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.080448 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.080617 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.080777 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.080920 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.081102 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.081215 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.081456 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.081556 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.081781 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.081878 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.082127 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.082213 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.082440 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.082528 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.082748 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.082836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.083060 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.083149 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.083374 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.083460 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.083670 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.083759 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.083989 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.084085 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.084290 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.084379 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.084587 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.084676 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.084884 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.084971 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.085179 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.085294 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.085530 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.085619 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.085827 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.085914 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.086139 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.086236 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.086449 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.086535 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.086755 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.086842 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.087055 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.087154 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.087379 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.087469 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.087697 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.087801 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.088003 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.088151 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.088315 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.088404 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.088632 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.088720 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.088928 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.089025 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.089225 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.089331 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.089555 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.089643 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.089852 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.089940 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.090140 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.090227 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.090437 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.090533 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.090738 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.090827 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.091034 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.091131 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.091331 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.091427 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.091627 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.091715 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.091942 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.092029 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.092238 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.092325 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.092552 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.092640 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.092854 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.092942 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.093150 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.093395 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.093488 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.093576 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.093755 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.093869 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.094094 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.094204 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.094390 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.094478 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.094709 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.094797 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.095012 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.095110 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.095349 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.095441 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.095659 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.095746 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.095967 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.096063 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.096273 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.096368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.096575 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.096661 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.096878 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.096973 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.097182 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.097310 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.097512 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.097598 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.097816 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.097908 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.098122 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.098210 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.098428 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.098515 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.098730 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.098818 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.099038 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.099238 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.099327 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.099561 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.099661 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.099870 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.099965 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.100178 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.100276 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.100482 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.100571 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.100789 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.100876 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.101095 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.101182 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.101426 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.101784 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.102006 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.102105 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.102310 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.102400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.102613 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.102702 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.102930 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.103018 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.103244 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.103331 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.103561 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.103649 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.103885 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.103971 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.104193 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.104300 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.104502 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.104591 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.104808 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.105017 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.105104 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.105382 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.105476 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.105687 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.105776 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.106008 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.106107 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.106321 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.106409 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.106637 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.106725 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.106945 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.107039 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.107250 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.107337 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.107554 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.107642 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.107863 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.107959 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.108169 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.108305 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.108473 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.108562 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.108777 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.108867 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.109081 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.109170 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.109413 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.109503 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.109736 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.109827 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.110065 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.110154 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.110379 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.110473 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.110684 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.110772 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.111508 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.111668 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.111817 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.111986 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.112293 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.112389 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.112608 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.112698 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.112928 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.113028 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.113246 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.113368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.113585 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.113701 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.113892 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.113989 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.114208 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.114354 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.114522 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.114663 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.114810 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.114947 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.115094 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.115223 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.115398 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.115536 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.115701 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.115839 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.116001 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.116133 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.116317 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.116481 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.116627 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.116763 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.116908 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.117061 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.117204 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.117363 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.117529 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.117626 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.118049 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.118139 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.118383 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.118479 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.118694 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.118782 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.119010 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.119106 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.119326 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.119426 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.119639 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.119727 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.119940 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.120028 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.120259 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.120359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.120561 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.120649 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.120864 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.120951 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.121174 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.121317 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.121507 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.121606 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.121808 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.121895 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.122107 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.122210 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.122411 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.122506 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.122714 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.122802 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.123014 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.123112 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.123318 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.123407 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.123618 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.123849 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.123946 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.124195 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.124282 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.124514 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.124617 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.124809 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.124897 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.125117 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.125203 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.125451 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.125541 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.125755 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.125844 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.126056 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.126144 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.126356 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.126443 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.127200 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.127298 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.127503 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.127592 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.127810 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.127898 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.128109 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.128201 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.128413 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.128542 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.128710 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.128806 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.129014 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.129109 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.129335 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.129427 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.129649 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.129748 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.129948 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.130078 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.130274 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.130361 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.130585 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.130687 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.130890 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.130976 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.131208 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.131309 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.131500 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.131600 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.131803 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.131897 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.132109 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.132196 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.132419 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.132514 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.132726 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.132947 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.133034 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.133284 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.133386 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.133609 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.133695 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.133935 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.134023 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.134248 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.134343 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.134557 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.134650 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.134856 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.134943 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.135158 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.135259 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.135478 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.135567 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.135782 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.135870 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.136086 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.136174 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.136391 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.136487 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.136698 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.136786 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.137003 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.137092 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.137330 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.137421 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.137641 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.137730 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.137947 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.138036 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.138253 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.138350 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.138556 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.138841 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.138930 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.139151 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.139237 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.139454 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.139549 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.139756 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.139845 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.140063 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.140152 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.140398 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.140486 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.140713 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.140802 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.141023 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.141109 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.141355 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.141443 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.141669 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.141758 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.141974 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.142061 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.142305 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.142405 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.142611 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.142698 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.142916 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.143003 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.143227 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.143323 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.143542 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.143628 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.143849 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.143944 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.144150 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.144246 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.144463 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.144595 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.144814 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.144901 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.145141 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.145229 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.145483 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.145584 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.145788 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.145875 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.146102 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.146191 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.146417 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.146507 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.146721 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.146808 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.147035 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.147130 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.147340 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.147428 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.147661 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.147756 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.147974 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.148060 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.148288 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.148385 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.148600 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.148737 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.148901 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.148997 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.149200 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.149335 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.149526 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.149627 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.149830 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.149918 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.150141 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.150233 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.150443 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.150564 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.150741 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.150882 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.151036 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.151205 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.151340 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.151530 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.151638 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.151844 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.151938 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.152169 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.152330 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.152494 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.152582 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.152791 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.152922 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.153087 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.153188 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.153406 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.153495 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.153705 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.153792 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.154002 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.154099 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.154298 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.154385 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.154597 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.154711 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.154900 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.155020 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.155197 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.155328 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.155496 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.155634 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.155794 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.155945 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.156092 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.156265 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.156388 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.156582 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.156713 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.156889 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.157038 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.157194 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.157369 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.157531 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.157686 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.157859 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.158017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.158167 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.158333 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.158472 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.158638 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.158776 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.158954 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.159085 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.159268 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.159387 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.159575 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.159691 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.159880 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.159996 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.160207 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.160304 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.160513 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.160609 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.160818 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.160918 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.161123 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.161220 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.161453 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.161551 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.161758 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.161858 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.162061 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.162159 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.162370 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.162505 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.162716 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.162820 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.163000 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.163104 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.163287 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.163384 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.163598 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.163694 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.163910 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.164005 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.164223 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.164318 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.164533 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.164633 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.164849 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.164941 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.165151 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.165237 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.165482 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.165584 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.165787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.165875 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.166091 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.166180 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.166395 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.166545 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.166702 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.166798 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.167005 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.167099 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.167312 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.167421 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.167614 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.167707 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.167924 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.168021 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.168233 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.168328 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.168549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.168642 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.168854 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.168941 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.169170 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.169259 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.169515 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.169605 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.169835 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.169931 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.170148 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.170234 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.170464 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.170552 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.170778 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.170875 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.171090 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.171176 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.171396 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.171484 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.171695 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.171790 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.171934 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 12:23:02.172021 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.172303 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.172616 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.172934 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.173245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.174115 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.174436 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.174755 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.175083 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.175409 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.175721 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.176045 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.176375 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.176723 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.177044 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.177419 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.177752 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.178069 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.178383 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.178691 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:23:02.178938 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 12:23:02.325173 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO dbcounter [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Registered counter for database nova_api Aug 10 12:23:02.331937 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO dbcounter [None req-824dba56-459e-4bbf-b382-191082c331de None None] Registered counter for database nova_api Aug 10 12:23:02.347185 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_db.sqlalchemy.engines [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:23:02.351191 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_db.sqlalchemy.engines [None req-824dba56-459e-4bbf-b382-191082c331de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:23:02.353914 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writer thread running {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:23:02.357933 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writer thread running {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:23:02.409112 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.context [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4613c154-23c5-442d-a568-3055672c6934(cell1) {{(pid=103037) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 12:23:02.413007 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_concurrency.lockutils [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:23:02.413458 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_concurrency.lockutils [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:23:02.413758 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.context [None req-824dba56-459e-4bbf-b382-191082c331de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4613c154-23c5-442d-a568-3055672c6934(cell1) {{(pid=103038) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 12:23:02.415013 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_concurrency.lockutils [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:23:02.415725 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_concurrency.lockutils [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:23:02.416162 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_concurrency.lockutils [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:23:02.417632 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-824dba56-459e-4bbf-b382-191082c331de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:23:02.418116 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-824dba56-459e-4bbf-b382-191082c331de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:23:02.418221 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_concurrency.lockutils [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:23:02.419688 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-824dba56-459e-4bbf-b382-191082c331de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:23:02.420082 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO dbcounter [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Registered counter for database nova_cell0 Aug 10 12:23:02.420417 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-824dba56-459e-4bbf-b382-191082c331de None None] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:23:02.420864 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-824dba56-459e-4bbf-b382-191082c331de None None] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:23:02.422892 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-824dba56-459e-4bbf-b382-191082c331de None None] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:23:02.425416 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO dbcounter [None req-824dba56-459e-4bbf-b382-191082c331de None None] Registered counter for database nova_cell0 Aug 10 12:23:02.425941 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO dbcounter [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Registered counter for database nova_cell1 Aug 10 12:23:02.430763 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO dbcounter [None req-824dba56-459e-4bbf-b382-191082c331de None None] Registered counter for database nova_cell1 Aug 10 12:23:02.433092 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_db.sqlalchemy.engines [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:23:02.435342 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_db.sqlalchemy.engines [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:23:02.437520 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_db.sqlalchemy.engines [None req-824dba56-459e-4bbf-b382-191082c331de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:23:02.440504 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writer thread running {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:23:02.441526 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_db.sqlalchemy.engines [None req-824dba56-459e-4bbf-b382-191082c331de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:23:02.444916 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writer thread running {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:23:02.574928 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writer thread running {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:23:02.583884 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writer thread running {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:23:02.585934 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO dbcounter [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Registered counter for database nova_cell0 Aug 10 12:23:02.593065 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO dbcounter [None req-824dba56-459e-4bbf-b382-191082c331de None None] Registered counter for database nova_cell0 Aug 10 12:23:02.595214 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG oslo_db.sqlalchemy.engines [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:23:02.600772 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writer thread running {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:23:02.603516 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_db.sqlalchemy.engines [None req-824dba56-459e-4bbf-b382-191082c331de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:23:02.607887 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writer thread running {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:23:02.938851 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: WARNING keystonemiddleware.auth_token [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:23:02.940962 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: WARNING keystonemiddleware.auth_token [None req-824dba56-459e-4bbf-b382-191082c331de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:23:02.946133 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: WARNING keystonemiddleware.auth_token [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:23:02.948249 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: WARNING keystonemiddleware.auth_token [None req-824dba56-459e-4bbf-b382-191082c331de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:23:03.284723 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: WARNING keystonemiddleware.auth_token [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:23:03.287521 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: WARNING keystonemiddleware.auth_token [None req-824dba56-459e-4bbf-b382-191082c331de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:23:03.290604 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: WARNING keystonemiddleware.auth_token [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:23:03.293453 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: WARNING keystonemiddleware.auth_token [None req-824dba56-459e-4bbf-b382-191082c331de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:23:03.295829 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d313509c0 pid: 103037 (default app) Aug 10 12:23:03.298036 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:23:03.298915 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d313509c0 pid: 103038 (default app) Aug 10 12:23:03.299182 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-ff68e583-1219-48d7-b7f5-db9fcf67b716 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001789 Aug 10 12:23:03.299586 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Wed Aug 10 12:23:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:17.723514 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-824dba56-459e-4bbf-b382-191082c331de None None] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:17.724836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-824dba56-459e-4bbf-b382-191082c331de None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002210 Aug 10 12:24:17.725235 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:17.737772 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writing DB stats nova_api:SELECT=3 {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:17.738904 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writing DB stats nova_cell1:SELECT=3 {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:17.740155 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writing DB stats nova_cell0:SELECT=3 {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:17.741010 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:18.596660 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-b7d6df5d-bfa8-446c-aca5-f627181cb12e admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:18.630136 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-b7d6df5d-bfa8-446c-aca5-f627181cb12e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.898058 Aug 10 12:24:18.630869 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 2/3] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 10 12:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:24:20.830461 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-824dba56-459e-4bbf-b382-191082c331de None None] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:20.831492 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-824dba56-459e-4bbf-b382-191082c331de None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 10 12:24:20.832180 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 2/4] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:21.312898 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-f39b7c49-dfe8-4f76-a1da-e054238b4b3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "swap": 0}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:21.335448 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:24:21.335448 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: warnings.warn(msg) Aug 10 12:24:21.365596 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-f39b7c49-dfe8-4f76-a1da-e054238b4b3b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.527267 Aug 10 12:24:21.367015 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 3/5] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:24:21.381069 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_api:SELECT=3 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:21.382272 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_cell0:SELECT=3 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:21.383804 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_cell1:SELECT=3 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:21.384887 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:21.600024 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-4fa294ef-83a0-486c-9b6a-a91f35885cfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:21.604552 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:24:21.604552 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: warnings.warn(msg) Aug 10 12:24:21.668017 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-4fa294ef-83a0-486c-9b6a-a91f35885cfb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292906 Aug 10 12:24:21.668744 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 3/6] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 10 12:24:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:24:23.909335 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-f39b7c49-dfe8-4f76-a1da-e054238b4b3b admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:23.910349 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-f39b7c49-dfe8-4f76-a1da-e054238b4b3b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 10 12:24:23.910742 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 4/7] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:24:24.581944 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-29d20a11-b2ab-4894-8b95-e6aa9103d1e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "disk": 5}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:24.601120 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:24:24.601120 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: warnings.warn(msg) Aug 10 12:24:24.622079 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-29d20a11-b2ab-4894-8b95-e6aa9103d1e5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.705256 Aug 10 12:24:24.623065 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 4/8] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:24:24.637104 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-135ec84a-7054-40a0-89dc-77dc2fe3b564 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:24.641044 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:24:24.641044 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: warnings.warn(msg) Aug 10 12:24:24.674365 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-135ec84a-7054-40a0-89dc-77dc2fe3b564 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041962 Aug 10 12:24:24.675241 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 5/9] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 10 12:24:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:24:26.926360 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-29d20a11-b2ab-4894-8b95-e6aa9103d1e5 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:26.927364 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-29d20a11-b2ab-4894-8b95-e6aa9103d1e5 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 10 12:24:26.927748 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:27.328299 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-2b09815c-07c2-4db5-8e7f-2c52fb31f2d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "ram": 1024}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:27.352117 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-2b09815c-07c2-4db5-8e7f-2c52fb31f2d3 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418114 Aug 10 12:24:27.352594 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 6/11] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:24:27.364499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-1ce3141d-24ad-4ebd-a508-ac359d32c7b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:27.388410 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-1ce3141d-24ad-4ebd-a508-ac359d32c7b0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027577 Aug 10 12:24:27.388961 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 6/12] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 10 12:24:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:24:29.587042 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-2b09815c-07c2-4db5-8e7f-2c52fb31f2d3 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:29.588650 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-2b09815c-07c2-4db5-8e7f-2c52fb31f2d3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002619 Aug 10 12:24:29.589361 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 7/13] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:24:30.041508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-8f2e944e-21f2-4d17-b0fe-3e81851a15c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3"}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:30.072313 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-8f2e944e-21f2-4d17-b0fe-3e81851a15c9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475445 Aug 10 12:24:30.073108 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 7/14] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:24:30.088637 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-9e777480-c8e2-4be0-b484-86f81f04e80e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:30.129908 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-9e777480-c8e2-4be0-b484-86f81f04e80e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047060 Aug 10 12:24:30.132254 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 8/15] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 10 12:24:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:24:32.343437 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-8f2e944e-21f2-4d17-b0fe-3e81851a15c9 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:32.344437 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-8f2e944e-21f2-4d17-b0fe-3e81851a15c9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 10 12:24:32.344854 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 8/16] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:32.769558 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-ec2e0651-df3a-4404-ab9d-daca6279e845 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:32.789365 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-ec2e0651-df3a-4404-ab9d-daca6279e845 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.438448 Aug 10 12:24:32.789909 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 9/17] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:24:32.802542 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-8046ee99-3a4c-4d26-98e0-f47a359ac311 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:32.826446 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-8046ee99-3a4c-4d26-98e0-f47a359ac311 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027380 Aug 10 12:24:32.827151 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 9/18] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 10 12:24:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:24:35.020471 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-ec2e0651-df3a-4404-ab9d-daca6279e845 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:35.021895 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-ec2e0651-df3a-4404-ab9d-daca6279e845 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 10 12:24:35.022405 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 10/19] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:35.465651 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-075edede-39c4-4874-912c-99eaf00907c6 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:35.491175 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-075edede-39c4-4874-912c-99eaf00907c6 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.462810 Aug 10 12:24:35.491707 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 10/20] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 10 12:24:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:24:38.055315 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-ec2e0651-df3a-4404-ab9d-daca6279e845 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:38.056748 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-ec2e0651-df3a-4404-ab9d-daca6279e845 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001793 Aug 10 12:24:38.057307 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 11/21] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:38.477219 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-4365ef3a-df12-4d4d-bb2c-a997d77e91ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "ram": 512, "disk": 1}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:38.495638 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-4365ef3a-df12-4d4d-bb2c-a997d77e91ac admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.429923 Aug 10 12:24:38.496206 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 11/22] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:24:38.508532 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-56b6e545-0e36-4ebc-ab03-95ce32328d0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:38.533168 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-56b6e545-0e36-4ebc-ab03-95ce32328d0e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028241 Aug 10 12:24:38.533853 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 12/23] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 10 12:24:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:24:40.720473 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-4365ef3a-df12-4d4d-bb2c-a997d77e91ac admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:40.721564 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-4365ef3a-df12-4d4d-bb2c-a997d77e91ac admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 10 12:24:40.721954 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 12/24] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:41.107942 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-77e450aa-9017-4e34-9ab4-def2a221e9f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "disk": 20, "id": "2", "vcpus": 1}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:41.128320 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-77e450aa-9017-4e34-9ab4-def2a221e9f7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.400229 Aug 10 12:24:41.128907 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 13/25] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:24:41.141423 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-f7b1ee78-e88b-4479-a2c8-a7a1db7860e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:41.164382 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-f7b1ee78-e88b-4479-a2c8-a7a1db7860e5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026922 Aug 10 12:24:41.164952 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 13/26] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 10 12:24:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:24:43.335461 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-77e450aa-9017-4e34-9ab4-def2a221e9f7 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:43.336477 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-77e450aa-9017-4e34-9ab4-def2a221e9f7 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 10 12:24:43.336882 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 14/27] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:43.750020 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-f7fece29-61d1-4b2d-90b2-51f333514978 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium"}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:43.774659 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-f7fece29-61d1-4b2d-90b2-51f333514978 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.431552 Aug 10 12:24:43.775312 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 14/28] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:24:43.787217 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-5a73c034-971f-47f5-942a-1832fb1cc70a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:43.812091 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-5a73c034-971f-47f5-942a-1832fb1cc70a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028136 Aug 10 12:24:43.821814 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 15/29] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 10 12:24:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:24:46.028889 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-f7fece29-61d1-4b2d-90b2-51f333514978 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:46.029942 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-f7fece29-61d1-4b2d-90b2-51f333514978 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 10 12:24:46.030528 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 15/30] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:46.462580 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-828bfc22-fe6e-48fd-8aea-90f547001150 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "ram": 8192}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:46.483653 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-828bfc22-fe6e-48fd-8aea-90f547001150 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446702 Aug 10 12:24:46.484609 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 16/31] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:24:46.496217 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-e7be60db-e711-4116-a204-3ed708991a0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:46.522485 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-e7be60db-e711-4116-a204-3ed708991a0c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029867 Aug 10 12:24:46.523586 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 16/32] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 10 12:24:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:24:48.727317 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-828bfc22-fe6e-48fd-8aea-90f547001150 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:24:48.728317 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-828bfc22-fe6e-48fd-8aea-90f547001150 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 Aug 10 12:24:48.728717 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 17/33] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:24:49.160631 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-fead78ef-ddd8-4024-81a4-7f618e4d0815 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:49.180336 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-fead78ef-ddd8-4024-81a4-7f618e4d0815 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.445624 Aug 10 12:24:49.180992 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 17/34] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 10 12:24:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:24:49.193544 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-bc5316f5-07ff-45ef-8101-3c2212e1c139 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:24:49.201714 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:24:49.221166 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-bc5316f5-07ff-45ef-8101-3c2212e1c139 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031350 Aug 10 12:24:49.221775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 18/35] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 10 12:24:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:25:09.358124 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-fead78ef-ddd8-4024-81a4-7f618e4d0815 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:09.359123 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-fead78ef-ddd8-4024-81a4-7f618e4d0815 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 10 12:25:09.359508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 18/36] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:25:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:09.749015 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-62c3793d-169c-4fe9-8943-f1f25815bebc admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:09.767259 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-62c3793d-169c-4fe9-8943-f1f25815bebc admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401778 Aug 10 12:25:09.767789 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 19/37] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 10 12:25:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:25:10.817189 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-fead78ef-ddd8-4024-81a4-7f618e4d0815 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:10.818226 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-fead78ef-ddd8-4024-81a4-7f618e4d0815 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 10 12:25:10.818619 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 19/38] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:11.333512 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-5b685440-11f0-49e2-8fd7-d4c8e987555c admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:11.339129 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.wsgi [None req-5b685440-11f0-49e2-8fd7-d4c8e987555c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-5b685440-11f0-49e2-8fd7-d4c8e987555c admin admin] Request method failure captured: Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Accept: application/json Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Accept-Encoding: gzip, deflate Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Connection: keep-alive Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Content-Length: 0 Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Host: 10.222.0.65 Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Openstack-Api-Version: compute 2.90 Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Openstack-System-Scope: None Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: User-Agent: python-novaclient Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Auth-Token: gAAAAABi86OmKXhZz0ZJ-SMoK1VKG9mXVEuNPWb5V0jf1SFYCW-5-J2u1T8M5X_8yM8NzigljrGtYzthW_yIZ-SzHVnOUZGz9TmU5RA2n_6Ph7MYuFdHGPshnMGpAGFDb7QvmYJnFgqPdyIdb-aC9Hg3uIsmSWxyIGoaN7XYHEBN5v8Hk6ZRgV8 Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Domain-Id: None Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Domain-Name: None Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Identity-Status: Confirmed Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Is-Admin-Project: True Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Domain-Id: default Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Domain-Name: Default Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Name: admin Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Role: admin,member,reader Aug 10 12:25:11.342416 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Roles: admin,member,reader Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}] Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant: admin Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant-Name: admin Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User: admin Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Domain-Id: default Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Domain-Name: Default Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Id: 474f14ac319744fba24161f36fcf9aa3 Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Name: admin Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: method: > Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: exception: Flavor 42 could not be found. Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: action_args: {'id': '42'} Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:25:11.344017 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:11.344992 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.346450 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-5b685440-11f0-49e2-8fd7-d4c8e987555c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:25:11.347689 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-5b685440-11f0-49e2-8fd7-d4c8e987555c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388053 Aug 10 12:25:11.347689 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 20/39] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 10 12:25:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:25:11.353560 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-1f1a0d8a-321c-402a-9641-f039410ee4fb admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:11.357780 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:25:11.377999 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-1f1a0d8a-321c-402a-9641-f039410ee4fb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028174 Aug 10 12:25:11.378519 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 20/40] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 10 12:25:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:25:11.388467 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-4cb3dc17-b86a-487b-a67c-627bf3d354b6 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:11.412372 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-4cb3dc17-b86a-487b-a67c-627bf3d354b6 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027767 Aug 10 12:25:11.412906 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 21/41] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 10 12:25:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:25:11.423349 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-ed0f55a7-e00a-4d97-822b-646f7c53153f admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:11.429541 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.wsgi [None req-ed0f55a7-e00a-4d97-822b-646f7c53153f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-ed0f55a7-e00a-4d97-822b-646f7c53153f admin admin] Request method failure captured: Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Accept: application/json Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Accept-Encoding: gzip, deflate Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Connection: keep-alive Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Content-Length: 0 Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Host: 10.222.0.65 Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Openstack-Api-Version: compute 2.90 Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Openstack-System-Scope: None Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: User-Agent: python-novaclient Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Auth-Token: gAAAAABi86OmKXhZz0ZJ-SMoK1VKG9mXVEuNPWb5V0jf1SFYCW-5-J2u1T8M5X_8yM8NzigljrGtYzthW_yIZ-SzHVnOUZGz9TmU5RA2n_6Ph7MYuFdHGPshnMGpAGFDb7QvmYJnFgqPdyIdb-aC9Hg3uIsmSWxyIGoaN7XYHEBN5v8Hk6ZRgV8 Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Domain-Id: None Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Domain-Name: None Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Identity-Status: Confirmed Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Is-Admin-Project: True Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Domain-Id: default Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Domain-Name: Default Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Name: admin Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Role: admin,member,reader Aug 10 12:25:11.432836 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Roles: admin,member,reader Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}] Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant: admin Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant-Name: admin Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User: admin Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Domain-Id: default Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Domain-Name: Default Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Id: 474f14ac319744fba24161f36fcf9aa3 Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Name: admin Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: method: > Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: exception: Flavor 42 could not be found. Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: action_args: {'id': '42'} Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:25:11.434368 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:11.435250 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:11.436499 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-ed0f55a7-e00a-4d97-822b-646f7c53153f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:25:11.438455 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-ed0f55a7-e00a-4d97-822b-646f7c53153f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015603 Aug 10 12:25:11.438455 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 21/42] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 10 12:25:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:25:12.383650 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-4cb3dc17-b86a-487b-a67c-627bf3d354b6 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:12.384702 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-4cb3dc17-b86a-487b-a67c-627bf3d354b6 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 10 12:25:12.385100 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 22/43] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:12.924183 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-4e5b52a8-cc3d-46c8-8fb8-b65b12268a96 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:12.929638 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.wsgi [None req-4e5b52a8-cc3d-46c8-8fb8-b65b12268a96 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-4e5b52a8-cc3d-46c8-8fb8-b65b12268a96 admin admin] Request method failure captured: Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Accept: application/json Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Accept-Encoding: gzip, deflate Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Connection: keep-alive Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Content-Length: 0 Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Host: 10.222.0.65 Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Openstack-Api-Version: compute 2.90 Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Openstack-System-Scope: None Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: User-Agent: python-novaclient Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Auth-Token: gAAAAABi86OoUlg_BtdwSbnXkkDW7wd8O63mAuWa8vgbwRi9PH_u9geqr8WSe1Xt97EtQE_RWm0j1PmrRsDICkc6rjM6bGA4pNtVUtx6IPOutksUTq9QuDNc_K7I67eXrVYtARwOl1Av89S3RCQ3RuHAyOgJo0wWmQNCc2OrwDZwO8fTFJPWQwI Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Domain-Id: None Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Domain-Name: None Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Identity-Status: Confirmed Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Is-Admin-Project: True Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Domain-Id: default Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Domain-Name: Default Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Name: admin Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Role: admin,member,reader Aug 10 12:25:12.931132 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Roles: admin,member,reader Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}] Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant: admin Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant-Name: admin Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User: admin Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Domain-Id: default Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Domain-Name: Default Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Id: 474f14ac319744fba24161f36fcf9aa3 Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Name: admin Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: method: > Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: exception: Flavor 84 could not be found. Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: action_args: {'id': '84'} Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:25:12.932400 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:12.933245 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:12.934359 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-4e5b52a8-cc3d-46c8-8fb8-b65b12268a96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:25:12.935763 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-4e5b52a8-cc3d-46c8-8fb8-b65b12268a96 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.409187 Aug 10 12:25:12.935763 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 22/44] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 10 12:25:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 12:25:12.942798 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-a91d8e72-0bb9-4ca5-83fe-26ec483a7cca admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:12.957347 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-a91d8e72-0bb9-4ca5-83fe-26ec483a7cca admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018131 Aug 10 12:25:12.957864 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 10 12:25:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:25:12.967166 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-712903d5-4e2c-40c7-9c15-72469944e0ff admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:12.982596 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-712903d5-4e2c-40c7-9c15-72469944e0ff admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018927 Aug 10 12:25:12.983109 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 10 12:25:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:25:12.992559 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-abb786a1-4cdb-4ae9-b1a7-440d6cb6da71 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:12.997783 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.wsgi [None req-abb786a1-4cdb-4ae9-b1a7-440d6cb6da71 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-abb786a1-4cdb-4ae9-b1a7-440d6cb6da71 admin admin] Request method failure captured: Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Accept: application/json Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Accept-Encoding: gzip, deflate Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Connection: keep-alive Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Content-Length: 0 Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Host: 10.222.0.65 Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Openstack-Api-Version: compute 2.90 Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Openstack-System-Scope: None Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: User-Agent: python-novaclient Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Auth-Token: gAAAAABi86OoUlg_BtdwSbnXkkDW7wd8O63mAuWa8vgbwRi9PH_u9geqr8WSe1Xt97EtQE_RWm0j1PmrRsDICkc6rjM6bGA4pNtVUtx6IPOutksUTq9QuDNc_K7I67eXrVYtARwOl1Av89S3RCQ3RuHAyOgJo0wWmQNCc2OrwDZwO8fTFJPWQwI Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Domain-Id: None Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Domain-Name: None Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Identity-Status: Confirmed Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Is-Admin-Project: True Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Domain-Id: default Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Domain-Name: Default Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Name: admin Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Role: admin,member,reader Aug 10 12:25:12.999258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Roles: admin,member,reader Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}] Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant: admin Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant-Name: admin Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User: admin Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Domain-Id: default Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Domain-Name: Default Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Id: 474f14ac319744fba24161f36fcf9aa3 Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Name: admin Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: method: > Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: exception: Flavor 84 could not be found. Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: action_args: {'id': '84'} Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:25:13.000787 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:13.001775 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:13.002996 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-abb786a1-4cdb-4ae9-b1a7-440d6cb6da71 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:25:13.004241 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-abb786a1-4cdb-4ae9-b1a7-440d6cb6da71 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011432 Aug 10 12:25:13.004241 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 24/47] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 10 12:25:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:25:13.992176 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-712903d5-4e2c-40c7-9c15-72469944e0ff admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:13.993175 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-712903d5-4e2c-40c7-9c15-72469944e0ff admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 10 12:25:13.993591 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 24/48] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:14.511121 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-de8810c5-3427-4895-91f3-626d49d66bdd admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:14.516861 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.wsgi [None req-de8810c5-3427-4895-91f3-626d49d66bdd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-de8810c5-3427-4895-91f3-626d49d66bdd admin admin] Request method failure captured: Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Accept: application/json Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Accept-Encoding: gzip, deflate Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Connection: keep-alive Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Content-Length: 0 Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Host: 10.222.0.65 Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Openstack-Api-Version: compute 2.90 Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Openstack-System-Scope: None Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: User-Agent: python-novaclient Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Auth-Token: gAAAAABi86OpPLLOYmS5wfsih6QdP6Gi5mbdXRcnqcJ__xatpMPrBMHnb5id5ooj0vgybCsmGxTx9u47OLMffwltJ3C2zo-gwUbNal7Fl5GTtOeEKr6P-CEQDi8_foRiK-grNtqYjovyiwg17MUUyzSihBEWDqai8dXL7oHQPs2GJCVXwcuarqg Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Domain-Id: None Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Domain-Name: None Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Identity-Status: Confirmed Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Is-Admin-Project: True Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Domain-Id: default Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Domain-Name: Default Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Project-Name: admin Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Role: admin,member,reader Aug 10 12:25:14.518956 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Roles: admin,member,reader Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}] Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant: admin Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-Tenant-Name: admin Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User: admin Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Domain-Id: default Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Domain-Name: Default Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Id: 474f14ac319744fba24161f36fcf9aa3 Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: X-User-Name: admin Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: method: > Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: exception: Flavor 451 could not be found. Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: action_args: {'id': '451'} Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:25:14.520549 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:14.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.522979 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-de8810c5-3427-4895-91f3-626d49d66bdd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:25:14.524216 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-de8810c5-3427-4895-91f3-626d49d66bdd admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391423 Aug 10 12:25:14.524216 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 25/49] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 10 12:25:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:25:14.529989 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-74ba7db7-bd3c-4329-9fb2-f3906be43261 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:14.545190 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-74ba7db7-bd3c-4329-9fb2-f3906be43261 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018740 Aug 10 12:25:14.545824 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 25/50] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 10 12:25:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:25:14.555022 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:14.570249 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018728 Aug 10 12:25:14.570770 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 26/51] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 10 12:25:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:25:14.580530 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-6f5ce418-08e2-4b04-ab29-a495fca6e97a admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:14.586018 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.wsgi [None req-6f5ce418-08e2-4b04-ab29-a495fca6e97a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-6f5ce418-08e2-4b04-ab29-a495fca6e97a admin admin] Request method failure captured: Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Accept: application/json Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Accept-Encoding: gzip, deflate Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Connection: keep-alive Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Content-Length: 0 Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Host: 10.222.0.65 Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Openstack-Api-Version: compute 2.90 Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Openstack-System-Scope: None Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: User-Agent: python-novaclient Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Auth-Token: gAAAAABi86OpPLLOYmS5wfsih6QdP6Gi5mbdXRcnqcJ__xatpMPrBMHnb5id5ooj0vgybCsmGxTx9u47OLMffwltJ3C2zo-gwUbNal7Fl5GTtOeEKr6P-CEQDi8_foRiK-grNtqYjovyiwg17MUUyzSihBEWDqai8dXL7oHQPs2GJCVXwcuarqg Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Domain-Id: None Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Domain-Name: None Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Identity-Status: Confirmed Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Is-Admin-Project: True Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Domain-Id: default Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Domain-Name: Default Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Project-Name: admin Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Role: admin,member,reader Aug 10 12:25:14.587508 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Roles: admin,member,reader Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bd2efc376f4648d0a2b40e0c73cde3c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bd2efc376f4648d0a2b40e0c73cde3c5"}]}] Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant: admin Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant-Id: bd2efc376f4648d0a2b40e0c73cde3c5 Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-Tenant-Name: admin Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User: admin Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Domain-Id: default Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Domain-Name: Default Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Id: 474f14ac319744fba24161f36fcf9aa3 Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: X-User-Name: admin Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: method: > Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: exception: Flavor 451 could not be found. Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: action_args: {'id': '451'} Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:25:14.589043 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:14.590048 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: ERROR nova.api.openstack.wsgi Aug 10 12:25:14.591285 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-6f5ce418-08e2-4b04-ab29-a495fca6e97a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:25:14.592503 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-6f5ce418-08e2-4b04-ab29-a495fca6e97a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012546 Aug 10 12:25:14.592503 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 26/52] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 10 12:25:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 12:25:15.551427 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:15.552431 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 10 12:25:15.552825 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 27/53] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:25:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:16.067143 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-50ffe1ec-0003-4285-aca9-8dcd020ef7e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:25:16.086358 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-50ffe1ec-0003-4285-aca9-8dcd020ef7e2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.397321 Aug 10 12:25:16.086886 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 27/54] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 10 12:25:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:25:17.044239 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:17.045258 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 10 12:25:17.045675 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 28/55] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:17.561396 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-c25048ce-005e-471d-961f-4f01ca2036c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:25:17.580848 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-c25048ce-005e-471d-961f-4f01ca2036c3 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.398208 Aug 10 12:25:17.581423 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 28/56] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 10 12:25:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:25:18.539811 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:18.540744 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 10 12:25:18.541139 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 29/57] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:19.057667 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-ef2a84a3-759a-484b-8b9e-a86708b2eb5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:25:19.076482 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-ef2a84a3-759a-484b-8b9e-a86708b2eb5c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.395362 Aug 10 12:25:19.077014 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 29/58] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 10 12:25:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:25:20.038175 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:20.039211 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 10 12:25:20.039600 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 30/59] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:20.561665 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-d8c2205e-b5f1-49ca-8a27-bc198454742f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:25:20.580619 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-d8c2205e-b5f1-49ca-8a27-bc198454742f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.402397 Aug 10 12:25:20.581169 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 30/60] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 10 12:25:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:25:21.541704 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:21.542696 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 10 12:25:21.543090 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 31/61] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:25:22.056302 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-4b2fb193-598b-4807-8503-ddd031702f95 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:25:22.076703 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-4b2fb193-598b-4807-8503-ddd031702f95 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.398128 Aug 10 12:25:22.077235 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 31/62] 10.222.0.65 () {60 vars in 1202 bytes} [Wed Aug 10 12:25:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:26:12.871467 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:26:12.872442 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-3ee43779-9016-433a-a0b2-fe1727d4fdee admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 10 12:26:12.872831 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 32/63] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 10 12:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:26:12.884001 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:26:13.260077 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-ce2ac47d-ca90-44db-84d7-de2ba316f57c admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:26:13.280060 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-ce2ac47d-ca90-44db-84d7-de2ba316f57c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400536 Aug 10 12:26:13.280593 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 32/64] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 10 12:26:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:26:13.305483 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-1dd208c2-167b-4819-bf54-a324b3ccaf1c admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:26:13.308863 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG dbcounter [-] [103037] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:26:13.314931 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-1dd208c2-167b-4819-bf54-a324b3ccaf1c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013025 Aug 10 12:26:13.315458 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 33/65] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 10 12:26:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:26:13.326830 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-6494e5a9-a627-48ca-8e50-b2f3c9a2c90f admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:26:13.334970 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-6494e5a9-a627-48ca-8e50-b2f3c9a2c90f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011700 Aug 10 12:26:13.335471 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 33/66] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 10 12:26:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:26:13.347292 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:26:13.355833 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012595 Aug 10 12:26:13.356463 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 34/67] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 10 12:26:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:26:13.367684 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-b951a395-fb9e-4c70-b039-ff15720cef67 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:26:13.375206 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-b951a395-fb9e-4c70-b039-ff15720cef67 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010993 Aug 10 12:26:13.375710 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 34/68] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 10 12:26:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:29:10.614081 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:29:10.615080 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 10 12:29:10.615470 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 35/69] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:29:10.754253 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_api:SELECT=6 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:29:10.911106 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-8f219b99-2fbe-411b-9c8b-5b3be335ad96 admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:29:10.913439 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:29:10.913439 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: warnings.warn(msg) Aug 10 12:29:10.914580 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-8f219b99-2fbe-411b-9c8b-5b3be335ad96 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:29:10.915044 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-8f219b99-2fbe-411b-9c8b-5b3be335ad96 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:29:10.915459 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-8f219b99-2fbe-411b-9c8b-5b3be335ad96 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:29:10.916154 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-8f219b99-2fbe-411b-9c8b-5b3be335ad96 admin admin] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:29:10.916588 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-8f219b99-2fbe-411b-9c8b-5b3be335ad96 admin admin] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:29:10.916993 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-8f219b99-2fbe-411b-9c8b-5b3be335ad96 admin admin] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:29:10.950198 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-8f219b99-2fbe-411b-9c8b-5b3be335ad96 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197409 Aug 10 12:29:10.950746 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 35/70] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 10 12:29:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:29:11.769154 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:29:11.770184 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 10 12:29:11.770599 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 36/71] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:29:11.958694 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-9822f56f-2200-4c66-ae01-1b17bdea7afb admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:29:11.961018 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:29:11.961018 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: warnings.warn(msg) Aug 10 12:29:11.962136 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-9822f56f-2200-4c66-ae01-1b17bdea7afb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:29:11.962670 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-9822f56f-2200-4c66-ae01-1b17bdea7afb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:29:11.963086 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-9822f56f-2200-4c66-ae01-1b17bdea7afb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:29:11.963808 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-9822f56f-2200-4c66-ae01-1b17bdea7afb admin admin] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:29:11.964242 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-9822f56f-2200-4c66-ae01-1b17bdea7afb admin admin] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:29:11.964647 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-9822f56f-2200-4c66-ae01-1b17bdea7afb admin admin] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:29:11.984570 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-9822f56f-2200-4c66-ae01-1b17bdea7afb admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075998 Aug 10 12:29:11.985099 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 36/72] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 10 12:29:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:29:23.215961 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:29:23.216961 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Aug 10 12:29:23.217394 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 37/73] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:29:23.360835 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_cell0:SELECT=4 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:29:23.361586 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_cell1:SELECT=4 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:29:23.362196 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG dbcounter [-] [103038] Writing DB stats nova_api:SELECT=8 {{(pid=103038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:29:23.409404 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-f3dadfc4-201b-47d0-9b6c-a3c09912e57d admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:29:23.411751 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:29:23.411751 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: warnings.warn(msg) Aug 10 12:29:23.412864 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-f3dadfc4-201b-47d0-9b6c-a3c09912e57d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:29:23.413355 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-f3dadfc4-201b-47d0-9b6c-a3c09912e57d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:29:23.413773 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-f3dadfc4-201b-47d0-9b6c-a3c09912e57d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:29:23.414492 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-f3dadfc4-201b-47d0-9b6c-a3c09912e57d admin admin] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:29:23.414929 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-f3dadfc4-201b-47d0-9b6c-a3c09912e57d admin admin] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:29:23.415334 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-f3dadfc4-201b-47d0-9b6c-a3c09912e57d admin admin] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:29:23.440156 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-f3dadfc4-201b-47d0-9b6c-a3c09912e57d admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083695 Aug 10 12:29:23.440634 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 37/74] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 10 12:29:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:29:24.260434 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: DEBUG nova.api.openstack.wsgi [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] Calling method '>' {{(pid=103037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:29:24.261543 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: INFO nova.api.openstack.requestlog [None req-a5062f0f-d5fa-43fe-8457-4a0b850ba9a8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 10 12:29:24.261937 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: [pid: 103037|app: 0|req: 38/75] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 10 12:29:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:29:24.455519 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG nova.api.openstack.wsgi [None req-faec53ea-95a7-4fc3-b964-855f436fdc0b admin admin] Calling method '>' {{(pid=103038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:29:24.457905 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:29:24.457905 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: warnings.warn(msg) Aug 10 12:29:24.459002 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-faec53ea-95a7-4fc3-b964-855f436fdc0b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:29:24.459479 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-faec53ea-95a7-4fc3-b964-855f436fdc0b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:29:24.459903 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-faec53ea-95a7-4fc3-b964-855f436fdc0b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:29:24.460615 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-faec53ea-95a7-4fc3-b964-855f436fdc0b admin admin] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:29:24.461057 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-faec53ea-95a7-4fc3-b964-855f436fdc0b admin admin] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:29:24.461501 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: DEBUG oslo_concurrency.lockutils [None req-faec53ea-95a7-4fc3-b964-855f436fdc0b admin admin] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:29:24.483235 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: INFO nova.api.openstack.requestlog [None req-faec53ea-95a7-4fc3-b964-855f436fdc0b admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081323 Aug 10 12:29:24.483730 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: [pid: 103038|app: 0|req: 38/76] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 10 12:29:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:30:19.751300 dv-cinder-852261-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 12:30:19.751873 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: Wed Aug 10 12:30:19 2022 - graceful shutdown triggered... Aug 10 12:30:19.752321 dv-cinder-852261-3-iscsi devstack@n-api.service[103037]: Gracefully killing worker 1 (pid: 103037)... Aug 10 12:30:19.752732 dv-cinder-852261-3-iscsi devstack@n-api.service[103038]: Gracefully killing worker 2 (pid: 103038)... Aug 10 12:30:20.753000 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: worker 1 buried after 1 seconds Aug 10 12:30:20.753000 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: worker 2 buried after 1 seconds Aug 10 12:30:20.753000 dv-cinder-852261-3-iscsi devstack@n-api.service[103036]: goodbye to uWSGI. Aug 10 12:30:20.754512 dv-cinder-852261-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 12:30:20.755083 dv-cinder-852261-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 12:30:20.757852 dv-cinder-852261-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 12:30:20.770952 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 12:30:20 2022] *** Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: nodename: dv-cinder-852261-3-iscsi Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: machine: x86_64 Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: clock source: unix Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: pcre jit disabled Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: detected number of CPU cores: 4 Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: current working directory: / Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: detected binary path: /usr/bin/uwsgi-core Aug 10 12:30:20.773589 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: your processes number limit is 47680 Aug 10 12:30:20.774307 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: your memory page size is 4096 bytes Aug 10 12:30:20.774307 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: detected max file descriptor number: 2048 Aug 10 12:30:20.774307 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: lock engine: pthread robust mutexes Aug 10 12:30:20.774307 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: thunder lock: enabled Aug 10 12:30:20.774307 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 12:30:20.774307 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 12:30:20.813824 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: Python main interpreter initialized at 0x563e633f09c0 Aug 10 12:30:20.813824 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: python threads support enabled Aug 10 12:30:20.813824 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: your server socket listen backlog is limited to 100 connections Aug 10 12:30:20.813824 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: your mercy for graceful operations on workers is 90 seconds Aug 10 12:30:20.814249 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 12:30:20.814249 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: *** Operational MODE: preforking *** Aug 10 12:30:20.814535 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: *** uWSGI is running in multiple interpreter mode *** Aug 10 12:30:20.814535 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: spawned uWSGI master process (pid: 118360) Aug 10 12:30:20.817463 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: spawned uWSGI worker 1 (pid: 118379, cores: 1) Aug 10 12:30:20.817463 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: spawned uWSGI worker 2 (pid: 118381, cores: 1) Aug 10 12:30:20.817463 dv-cinder-852261-3-iscsi devstack@n-api.service[118360]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 12:30:20.814743 dv-cinder-852261-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 12:30:21.489655 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 12:30:21.492009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 12:30:22.678555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:30:22.678555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: from cryptography.utils import int_from_bytes Aug 10 12:30:22.679164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:30:22.679164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: from cryptography.utils import int_from_bytes Aug 10 12:30:22.679763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:30:22.679763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: from cryptography.utils import int_from_bytes Aug 10 12:30:22.680194 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:30:22.680194 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: from cryptography.utils import int_from_bytes Aug 10 12:30:25.073093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 12:30:25.073666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 12:30:25.073914 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 12:30:25.074278 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 12:30:25.074542 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 12:30:25.074936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.075269 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.075603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.075927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.076266 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.076583 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.076910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.077235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.077591 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.077855 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.078210 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.078540 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852261-3-iscsi {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.078891 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.079177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.079492 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.079819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.080137 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.080447 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.081402 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.081402 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.082100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.082410 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.082919 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.083341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.083606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.083912 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.084324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.084555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.084901 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.085206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.085652 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852261-3-iscsi {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.085973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.086291 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.086610 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.087031 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.087348 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.087665 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.087992 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.088321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.088634 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.088968 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.089314 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.089640 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.089968 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.090282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.090598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.090911 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.091238 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.091556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.091858 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.092114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.092428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.092755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.093081 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.093428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.094216 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.094472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.094797 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.095124 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.095437 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.095752 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.096067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.096380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.096691 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.097003 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.097425 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.097650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.098235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.098555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.098880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.099191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.099517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.099917 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.100172 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.100483 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.100826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.101149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.101485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.101810 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.102134 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.102446 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.102755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.103066 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.103387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.103728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.104036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.104291 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.104598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.104908 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.105229 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.105567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.105886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.106213 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.106504 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.106815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.107125 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.107435 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.107744 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.108055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.108362 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.108986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.108986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.111277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.111277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.111277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.111277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.111277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.111633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.111718 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.111986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.112296 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.112607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.112950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.113242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.113575 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.113893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.114376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.114702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.115026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.115333 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.115647 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.115969 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.116285 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.116593 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.116899 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.117311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.117628 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.117938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.118245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.118553 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.118857 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.119178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.119505 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.119818 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.120141 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.120447 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.120770 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.121106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.121467 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.121817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.122139 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.122475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.122814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.123135 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.123448 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.123767 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.124097 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.124409 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.124724 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.125086 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.125430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.125755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.126095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.126414 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.126735 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.127058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.127371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.127692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.128025 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.128350 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.128663 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.129009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.129377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.129696 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.130026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.130352 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.130665 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.130979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.131294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.131615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.131947 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.132266 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.132583 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.132899 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.133214 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.133552 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.133868 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.134186 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.134526 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.134842 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.135163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.135477 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.135797 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.136117 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.136431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.136743 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.137050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.137380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.137691 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.138003 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.138316 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.138637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.138967 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.139282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.139621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.139928 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.140243 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.140581 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.140894 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.141202 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.141547 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.141856 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.142163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.142489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.142803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.143109 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.143432 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.143742 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.144046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.144365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.144685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.144991 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.145430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.145638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.145964 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.146290 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.146604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.146942 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.147274 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.147579 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.147903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.148228 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.148548 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.148855 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.149166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.149496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.149860 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.150107 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.150416 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.150723 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.151034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.151336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.151642 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.151950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.152274 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.152582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.152887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.153194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.153527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.153871 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.154180 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.154529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.154867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.155268 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.155524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.155819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.156720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.156995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.157465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.157637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.157950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.158276 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.158607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.158921 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.159234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.159562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.159873 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.160196 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.160502 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.160822 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.161168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.161529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.161850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.162177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.162491 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.162809 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.163123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.163439 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.163752 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.164065 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.164387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.164701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.165020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.165357 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.165685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.165995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.166315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.166629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.166945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.167227 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 12:30:25.167684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.167828 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 12:30:25.167968 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.167968 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.168231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 12:30:25.168368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.168507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 12:30:25.168637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.168768 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 12:30:25.168928 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.169061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.169199 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.169395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.169538 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.169669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.169809 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.169947 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.170078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.170271 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.170405 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.170590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.170725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.170915 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.171049 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.171227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.171360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.171536 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.171702 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.172452 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.172603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.172751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.172890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.173031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852261-3-iscsi {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.173176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.173348 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.173492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.173624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.173761 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.173899 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.174041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.174212 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.174347 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.174524 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.174657 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.174846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.174981 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.175153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.175288 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.175461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.175719 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.175950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.176102 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.176235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.176365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.176494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.176632 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.176777 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.176906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.177049 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.177181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.177342 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.177498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.177630 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.177813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.177949 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.178127 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.178272 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.178456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.178599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.178772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.178916 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.179133 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.179277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852261-3-iscsi {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.179445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.179588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.179759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.179893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.180084 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.180227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.180398 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.180531 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.180708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.180842 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.181022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.181157 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.181359 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.181518 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.181666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.181898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.182030 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.182212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.182344 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.182561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.182699 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.182889 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.183030 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.183179 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.183301 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.183485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.183613 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.183797 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.183931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.184167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.184305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.184419 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.184685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.184814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.185021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.185150 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.185350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.185473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.185599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.185740 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.186045 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.186375 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.186703 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.187030 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.187170 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.187336 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.187471 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.187626 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.187759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.187894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.188079 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.188221 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.188431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.188575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.188750 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.188885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.189071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.189205 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.189411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.189579 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.189725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.189895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.190044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.190207 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.190355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.190520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.190715 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.190861 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.190999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.191279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.191419 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.191590 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.191724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.191897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.192037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.192205 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.192353 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.192497 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.192642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.192855 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.192993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.193130 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.193374 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.193517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.193657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.193796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.193929 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.194060 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.194219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.194360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.194491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.194629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.194759 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.194928 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.195072 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.195233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.195366 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.195582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.195728 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.195893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.196148 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.196347 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.196490 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.196620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.196750 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.196888 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.197025 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.197157 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.197356 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.197511 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.197643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.197788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.197920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.198058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.198193 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.198332 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.198462 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.198637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.198773 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.198948 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.199091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.199256 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.199398 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.199568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.199704 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.199878 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.200012 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.200186 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.200330 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.200495 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.200629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.200803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.200944 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.201104 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.201247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.201439 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.201575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.201746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.201889 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.202053 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.202201 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.202379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.202524 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.202663 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.202795 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.203540 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.203691 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.203823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.203953 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.204090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.204217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.204356 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.204495 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.204670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.204806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.204974 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.205117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.205308 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.205460 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.205620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.205768 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.205927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.206061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.206286 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.206505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.206633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.206772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.206903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.207040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.207170 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.207289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.207425 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.207566 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.207734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.207869 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.208042 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.208176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.208352 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.208494 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.208661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.208802 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.208968 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.209104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.209305 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.209454 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.209587 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.209718 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.209894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.210039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.210203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.210346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.210507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.210650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.210814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.210958 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.211098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.211237 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.211423 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.211569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.211730 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.211864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.212043 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.212178 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.212376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.212529 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.212661 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.212807 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.212939 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.213085 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:30:25.213245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.213400 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.213614 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.213757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.213897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.214072 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.214202 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.214395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.214534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.214743 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.214874 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.215080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.215200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.215402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.215531 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.215719 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.215846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.216038 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.216158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.216374 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.216530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.217168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.217326 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.219917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.221338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.221338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.221529 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.221618 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.221694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.221765 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.221842 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.221919 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222150 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222307 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222529 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222738 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.222820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223700 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.223976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.224291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.224607 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.224934 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.225298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.225565 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.225648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.225925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.226024 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.226243 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.226334 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.226559 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.226825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.226920 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.227165 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.227257 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.227480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.227567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.227823 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.227919 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.228447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.228555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.228637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.228716 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.228796 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.228881 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.229065 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.229156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.229720 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.229720 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.230039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.230182 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.230311 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.230495 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.230629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.230897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.231053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.231309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.231454 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.231582 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.231821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.231950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.232152 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.232352 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.232483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.232788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.232928 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.233097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.233293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.233440 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.233759 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.233888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.234073 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.234388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.234521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.234794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.234951 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.235089 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.235309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.235455 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.235640 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.235803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.235944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.236246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.236385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.236572 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.236759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.236889 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.237177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.237520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.237664 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.237837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.238038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.238185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.238721 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.238870 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.239015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.239151 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.239279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.239406 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.239572 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.239715 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.239919 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.240052 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.240315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.240456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.240623 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.240820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.240966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.241281 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.241427 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.241618 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.241895 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.242029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.242233 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.242392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.242531 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.242833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.242962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.243142 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.243339 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.243471 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.243750 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.243887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.244058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.244342 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.244475 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.244660 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.244843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.244975 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.245301 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.245452 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.245628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.245812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.245944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.246229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.246362 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.246537 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.246722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.246886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.247195 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.247332 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.247543 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.247778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.247930 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.249025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.249163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.249342 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.249487 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.249660 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.249790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.250120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.250120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.250368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.250506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.250506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.250763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.250899 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.251027 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.251154 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.251154 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.251412 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.251547 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.251676 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.251801 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.251939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.252190 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.252330 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.252553 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.252691 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.252862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.253127 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.253286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.253612 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.253755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.253955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.254653 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.254882 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.255015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.255143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.255143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.255403 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.255530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.255671 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.255808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.255943 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.256069 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.256203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.256463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.256606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.256786 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.256991 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.257132 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.257434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.257630 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.257771 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.258158 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.258286 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.258420 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.258575 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.259051 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.259051 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.259311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.259441 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.259574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.259827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.259970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.260113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.260309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.260503 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.260642 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.260827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.261038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.261180 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.261481 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.261620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.261803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.261973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.262115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.262407 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.262536 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.262720 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.262902 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.263116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.263336 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.263474 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.263649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.263838 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.263978 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.264259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.264391 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.264572 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.264843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.264975 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.265174 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.265371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.266028 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.266324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.266457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.266659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.266848 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.266987 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.267285 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.267427 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.267593 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.268051 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.268207 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.268344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.268472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.268607 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.268831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.269315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.269464 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.269602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.269778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.270015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.270148 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.270148 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.270495 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.270634 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.270762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.270896 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.271024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.271192 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.271334 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.271624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.271762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.271938 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.272109 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.272324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.272546 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.272681 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.272867 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.273035 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.273175 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.273505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.273639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.273821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.274013 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.274144 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.274431 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.274572 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.274755 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.275051 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.275183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.275364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.275581 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.275715 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.275967 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.276098 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.276281 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.276520 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.276667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.276981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.277166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.277451 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.277586 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.277868 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.278076 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.278209 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.278502 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.278632 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.278825 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.279289 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.279442 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.279573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.279707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.279883 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.280027 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.280250 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.280383 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.280592 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.280723 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.280864 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.280994 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.281849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.281993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.282178 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.282347 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.282493 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.282784 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.282915 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.283136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.283275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.283418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.283698 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.283841 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.284007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.284273 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.284405 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.284616 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.284759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.284922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.285217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.285380 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.285626 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.285790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.285976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.286243 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.286383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.286581 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.286718 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.286888 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.287151 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.287290 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.287524 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.287663 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.287930 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.288219 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.288360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.288570 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.289733 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.289928 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.290084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.290229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.290448 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.290596 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.290787 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.290918 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.290918 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.291178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.291307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.291442 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.291578 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.291578 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.291835 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.291970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.291970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.292219 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.292345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.292345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.292596 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.292723 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.292849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.292983 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.293111 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.293333 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.293483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.293728 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.293906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.294045 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.294261 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.294402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.294630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.294768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.294935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.295246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.295556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.295696 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.295864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.296100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.296240 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.296465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.296618 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.297014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.297154 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.297474 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.297620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.297773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.298079 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.298212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.298391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.298599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.298730 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.298996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.299134 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.299326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.299557 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.300009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.300144 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.300277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.300277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.300648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.300795 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.300998 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.301137 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.301137 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.301453 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.301588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.301756 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.301886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.302078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.302325 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.302463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.302695 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.302831 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.303005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.303274 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.303412 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.303610 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.303765 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.303922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.304213 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.304351 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.304526 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.304752 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.304892 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.305129 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.305384 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.305520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.305777 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.305905 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.306090 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.306304 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.306436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.307171 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.307324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.307455 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.307581 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.307719 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.307848 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.307975 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.307975 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.308232 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.308367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.308571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.308703 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.308898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.309145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.309299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.309564 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.310161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.310304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.310441 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.310570 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.310793 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.310939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.310939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.311285 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.311550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.311682 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.311810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.311810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.312070 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.312200 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.312361 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.312492 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.312629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.312926 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.313060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.313254 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.313491 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.313633 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.313884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.314017 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.314194 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.314510 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.314671 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.314825 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.315139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.315270 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.315452 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.316014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.316162 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.316162 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.316430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.316559 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.316693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.316821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.316970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.317142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.317306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.317624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.317940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.318252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.318481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.318658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.318916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.319052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.319186 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.319433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.319581 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.319808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.320281 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.320530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.320669 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.320814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.321029 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.321255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.321255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.321615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.321744 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.321872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.321998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.322140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.322275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.322402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.322638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.322777 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.322970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.323141 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.323282 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.323583 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.323710 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.323990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.324553 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.324875 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.325189 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.325874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.326049 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.326521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.326764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.326952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.327214 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.327542 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.327852 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.328729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.329139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.329503 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.329819 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.330480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.330643 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.330813 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.330972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.331412 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.331664 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.331829 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.331986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.332146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.332289 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.332438 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.332588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.332728 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.332869 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.333079 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.333237 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.333433 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.333585 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.333735 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.333876 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.334037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.334185 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.334326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.334468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.334608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.334757 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.334974 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.335142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.335285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.335434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.335575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.335762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.335973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.336118 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.336259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.336407 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.336549 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.336704 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.336891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.337037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.337197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.337363 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.337522 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.337664 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.337805 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.337805 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.338071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.338210 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.338359 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.338499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.338650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.338791 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.338931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.339080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.339229 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.339376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.339524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.339668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.339847 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.339997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.340576 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.340740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.340883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.341031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.341173 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.341354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.341611 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.341851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.342008 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.342169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.342311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.342465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.342465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.342742 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.342742 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.343009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.343009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.343612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.344253 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.344408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.344549 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.344699 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.347173 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.347371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.347535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.347684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.348098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.348247 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.348395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.348699 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.348851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.349014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.349159 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.349159 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.349568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.349718 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.349867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.350028 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.350028 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.350817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.350979 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.351122 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.351264 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.351264 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.351558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.351829 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.352060 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.352211 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.352361 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.352510 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.352651 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.352805 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.352947 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.353088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.353236 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.353415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.353565 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.353735 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.353876 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.354024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.354164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.354305 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.354452 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.354661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.354804 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.354952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.355092 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.355239 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.355380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.355540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.356937 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357052 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357144 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357239 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357560 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.357995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358079 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358169 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358253 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358335 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358511 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358602 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358694 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358694 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358860 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.358953 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359034 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359112 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359210 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359285 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359750 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359842 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.359938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360104 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360187 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360269 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360362 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360442 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360593 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360677 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360912 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.360996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361172 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361172 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361520 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361668 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.361822 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.362059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.362226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.362373 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.362526 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.362682 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.362837 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.362989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.363140 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.363285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.363437 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.363580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.363732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.363878 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.364021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.364164 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.364321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.364476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.364619 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.364762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.364905 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.365056 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.365200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.365385 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.365531 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.365784 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.365950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.366109 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.366254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.366416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.366574 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.366717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.366867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.367026 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.367177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.367320 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.367463 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.367614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.367778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.367929 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.368074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.368225 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.368379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.368522 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.368679 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.368830 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.368987 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.369136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.370436 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.370618 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.370784 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.370938 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.370938 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.371214 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.371376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.371531 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.371674 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.371827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.371978 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.372121 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.372266 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.372418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.372899 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.373071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.373071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.373390 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.373556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.374372 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.374532 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.374686 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.374867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.375019 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.375164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.375320 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.375466 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.375617 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.375762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.375913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.376073 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.376229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.376374 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.376526 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.376686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.377082 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.377251 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.377435 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.377598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.377742 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.377946 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.378101 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.378256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.378408 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.378569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.378713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.378863 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.379025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.379184 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.379329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.379473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.379625 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.379776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.379934 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.380087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.380231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.380381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.380636 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.380796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.380950 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.381109 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.381253 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.381475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.381621 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.381765 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.381926 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.382078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.382221 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.382371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.382532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.382753 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.382899 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.383050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.383204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.383204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.383483 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.383639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.383792 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.383935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.384078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.384220 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.384371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.384538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.384689 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.384834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.384977 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.385120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.385425 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.385597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.385743 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.385886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.386037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.386187 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.386339 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.386499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.386643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.386786 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.386937 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.387099 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.387342 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.387500 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.387644 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.387787 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.387931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.388081 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.388081 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.388379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.388540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.388683 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.388833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.388983 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.389138 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.389301 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.389451 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.389594 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.389778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.389941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.390087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.390246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.390398 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.391166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 12:30:25.391326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.391326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.391326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.391326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.391326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.391326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.392143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.392143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.392432 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.392575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.393042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.393491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.393850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.394184 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.394538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.394880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.395197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.395511 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.395826 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.396160 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.396480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.396795 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.397114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.397499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.397774 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.398072 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.398392 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.398707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.399022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.399338 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.399655 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.399970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.400286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.400599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.400924 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.401317 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.401634 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.401957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.402278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.402602 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.402918 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.403235 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.403549 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.403863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.404184 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.404523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.404844 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.405156 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.405636 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.405955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.406841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.407170 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.407486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.407810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.408130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.408446 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.408771 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.409084 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.409448 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.409799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.410134 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.410465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.410776 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.411084 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.411398 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.411709 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.412033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.412345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.412652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.412959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.413367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.413603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.413911 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.414219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.414527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.414839 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.415144 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.415450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.415757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.416063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.416369 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.416683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.416995 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.417322 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.417634 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.417957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.418244 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.418551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.418897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.419236 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.419558 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.419884 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.420202 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.420526 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.421342 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.421342 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.421847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.421847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.422155 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.422481 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.422796 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.423115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.423519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.423895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.424218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.424534 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.424879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.425214 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.425561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.425895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.426218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.426546 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.426868 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.427183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.427519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.427834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.428170 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.428459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.428775 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.429086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.429715 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.429905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.430082 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.430630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.430802 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.431263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.431709 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.431910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.432404 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.432742 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.433440 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.433765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.434015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.434349 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.434670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.435131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.435443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:30:25.435697 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 12:30:25.548891 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO dbcounter [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Registered counter for database nova_api Aug 10 12:30:25.569080 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_db.sqlalchemy.engines [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:30:25.579498 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writer thread running {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:30:25.587224 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO dbcounter [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Registered counter for database nova_api Aug 10 12:30:25.607183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:30:25.613709 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writer thread running {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:30:25.635776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.context [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4613c154-23c5-442d-a568-3055672c6934(cell1) {{(pid=118381) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 12:30:25.639875 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:30:25.640359 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:30:25.642505 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:30:25.643258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:30:25.643722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:30:25.645764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:30:25.647775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO dbcounter [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Registered counter for database nova_cell0 Aug 10 12:30:25.651874 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO dbcounter [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Registered counter for database nova_cell1 Aug 10 12:30:25.659115 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_db.sqlalchemy.engines [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:30:25.661366 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_db.sqlalchemy.engines [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:30:25.666466 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writer thread running {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:30:25.669815 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.context [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4613c154-23c5-442d-a568-3055672c6934(cell1) {{(pid=118379) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 12:30:25.671746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writer thread running {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:30:25.673958 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:30:25.674440 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:30:25.676006 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:30:25.676753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:30:25.677209 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:30:25.679229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:30:25.681207 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO dbcounter [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Registered counter for database nova_cell0 Aug 10 12:30:25.685207 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO dbcounter [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Registered counter for database nova_cell1 Aug 10 12:30:25.693204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:30:25.694594 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:30:25.701024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writer thread running {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:30:25.703717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writer thread running {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:30:25.818002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO dbcounter [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Registered counter for database nova_cell0 Aug 10 12:30:25.824465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_db.sqlalchemy.engines [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:30:25.829629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writer thread running {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:30:25.851013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO dbcounter [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Registered counter for database nova_cell0 Aug 10 12:30:25.857845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:30:25.862732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writer thread running {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:30:26.150583 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: WARNING keystonemiddleware.auth_token [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:30:26.157889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: WARNING keystonemiddleware.auth_token [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:30:26.181249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: WARNING keystonemiddleware.auth_token [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:30:26.189145 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: WARNING keystonemiddleware.auth_token [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:30:26.516701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: WARNING keystonemiddleware.auth_token [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:30:26.522725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: WARNING keystonemiddleware.auth_token [None req-a3daa763-9e42-43bd-8488-69c0b737c8de None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:30:26.529004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563e633f09c0 pid: 118381 (default app) Aug 10 12:30:26.544167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: WARNING keystonemiddleware.auth_token [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:30:26.550218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: WARNING keystonemiddleware.auth_token [None req-7fc0a3cc-5fac-451f-ab83-d592e8d3c97e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:30:26.556431 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563e633f09c0 pid: 118379 (default app) Aug 10 12:31:01.632194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:01.634983 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:01.637368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:01.638560 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:03.465652 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c91b6728-bfe4-4753-b9d9-06b66c2be794 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Action: 'create', calling method: .version_select at 0x7fcb98fc5e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-162622584"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:04.814645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:04.815459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:04.819860 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:04.821098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:04.849910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c91b6728-bfe4-4753-b9d9-06b66c2be794 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.248991 Aug 10 12:31:04.852002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1155 bytes} [Wed Aug 10 12:31:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3253 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 12:31:04.871240 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8afffd8a-4acd-4a5b-9728-7a224965352f tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98e07ca0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:04.990271 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8afffd8a-4acd-4a5b-9728-7a224965352f tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87" status: 200 len: 344 microversion: 2.1 time: 0.113531 Aug 10 12:31:04.990271 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 2/2] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:31:04 2022] GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 => generated 344 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:05.277203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-40c3b792-e8cd-4e4e-bc07-c14884198927 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98f888b0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:05.864059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-40c3b792-e8cd-4e4e-bc07-c14884198927 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/2ac5ab54-3317-4503-aa87-6233f2dcc24c" status: 200 len: 351 microversion: 2.1 time: 1.054801 Aug 10 12:31:05.866396 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 1/3] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:31:04 2022] GET /compute/v2.1/os-volumes/2ac5ab54-3317-4503-aa87-6233f2dcc24c => generated 351 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:31:05.996370 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-36d6c9a1-1f5f-4c12-915c-073d21ceae76 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98da73a0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:06.084615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-36d6c9a1-1f5f-4c12-915c-073d21ceae76 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87" status: 200 len: 345 microversion: 2.1 time: 0.092628 Aug 10 12:31:06.085755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 3/4] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:31:05 2022] GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:06.109641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-02f58134-9471-471b-8b43-4424628541b2 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Action: 'create', calling method: .version_select at 0x7fcb98dcdb80>, body: {"snapshot": {"volume_id": "f8166002-7272-4df6-be14-688391140a87", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-953832568"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:06.685987 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-02f58134-9471-471b-8b43-4424628541b2 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.590477 Aug 10 12:31:06.688350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 2/5] 10.222.0.65 () {60 vars in 1162 bytes} [Wed Aug 10 12:31:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:06.705046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2e5f10ef-37f4-4bb4-ba51-4b6c0674cf0c tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98da7a60>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:06.897287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2e5f10ef-37f4-4bb4-ba51-4b6c0674cf0c tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 200 len: 286 microversion: 2.1 time: 0.198255 Aug 10 12:31:06.898446 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 4/6] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:06 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:06.913412 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2a785deb-70d1-45fc-8ccd-cd13df7ae145 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98dcdd30>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:06.993690 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2a785deb-70d1-45fc-8ccd-cd13df7ae145 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.086137 Aug 10 12:31:07.001062 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 3/7] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 10 12:31:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:07.011117 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-128ffc33-e138-4c3f-b1b5-f338a7077b76 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98e07ca0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:07.051171 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-128ffc33-e138-4c3f-b1b5-f338a7077b76 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 200 len: 286 microversion: 2.1 time: 0.049082 Aug 10 12:31:07.051906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 5/8] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:07 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:08.078791 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-070e70a0-c8f6-47a7-ba4e-743414042564 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98da5160>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:08.093941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bffc4fa8-5e5a-42da-8fdc-94125fe2dd99 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98da7940>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:08.203181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-070e70a0-c8f6-47a7-ba4e-743414042564 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 200 len: 286 microversion: 2.1 time: 0.142997 Aug 10 12:31:08.203919 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 4/9] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:08 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:31:08.263480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bffc4fa8-5e5a-42da-8fdc-94125fe2dd99 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/28f19b62-07fe-495b-81f9-6c14acc8713f" status: 200 len: 351 microversion: 2.1 time: 0.194550 Aug 10 12:31:08.265002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 6/10] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:31:08 2022] GET /compute/v2.1/os-volumes/28f19b62-07fe-495b-81f9-6c14acc8713f => generated 351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:09.223972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-69bd1ffe-8bc1-4906-bf6d-d239e5d62ee7 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98d8c310>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:09.275485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-69bd1ffe-8bc1-4906-bf6d-d239e5d62ee7 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 200 len: 286 microversion: 2.1 time: 0.063310 Aug 10 12:31:09.276432 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 5/11] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:09 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:10.287965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b0b02bc3-9b78-4671-a15b-aa24276fcc27 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98da70d0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:10.341221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b0b02bc3-9b78-4671-a15b-aa24276fcc27 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 200 len: 286 microversion: 2.1 time: 0.056524 Aug 10 12:31:10.343294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 7/12] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:10 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:11.357854 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4e8136c8-5e50-4726-b247-5a4d54bea707 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98d8c700>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:11.414584 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4e8136c8-5e50-4726-b247-5a4d54bea707 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 200 len: 287 microversion: 2.1 time: 0.062575 Aug 10 12:31:11.429055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 6/13] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:11 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:11.432329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4f440524-2d94-4145-a713-caf69ba48885 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98da7160>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:11.615869 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4f440524-2d94-4145-a713-caf69ba48885 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 202 len: 0 microversion: 2.1 time: 0.190687 Aug 10 12:31:11.616948 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 8/14] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Aug 10 12:31:11 2022] DELETE /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:31:11.627219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0bcf9b11-a700-4e67-aa08-45ead802d4f6 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb99719040>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:11.732146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0bcf9b11-a700-4e67-aa08-45ead802d4f6 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 200 len: 286 microversion: 2.1 time: 0.110152 Aug 10 12:31:11.744475 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 7/15] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:11 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:12.746566 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b8c62ebd-859d-4323-b19e-21e51e0b46ba tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98da7940>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:12.835556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b8c62ebd-859d-4323-b19e-21e51e0b46ba tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 200 len: 286 microversion: 2.1 time: 0.092917 Aug 10 12:31:12.836677 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 9/16] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:12 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:13.856900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7d621c9f-b364-4971-aeca-e54fa57e8375 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98dcd8b0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:13.900464 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-7d621c9f-b364-4971-aeca-e54fa57e8375 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] HTTP exception thrown: Snapshot f6e42b49-04e4-47ec-9705-a4d6411a70ad could not be found. Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7d621c9f-b364-4971-aeca-e54fa57e8375 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Request method failure captured: Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad HTTP/1.1 Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UFOstn6xiN93OsC8g3ayu-fSdViIF0xS8S_KyyArI7NiRDiQXN6vvu3iW4DqNPynHFxkD_TMCtLcoloLQID3XTDKLDPhR90q5-dsh0jxD8yseMLFkaHa58kJaOb_9FI8XwGr1q86-nImXyIBTy1dRTiuMVpBhYiCSTOPzl5HQ_Q0Y Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: a99cd651b5c8474fb336b307cbba38cd Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:31:13.906713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a99cd651b5c8474fb336b307cbba38cd"}]}] Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: a99cd651b5c8474fb336b307cbba38cd Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesSnapshotsTestJSON-454025635-project Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9ea99f7a48134f2b8a36f5d67c22ad51 Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-454025635-project Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Snapshot f6e42b49-04e4-47ec-9705-a4d6411a70ad could not be found. Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'f6e42b49-04e4-47ec-9705-a4d6411a70ad'} Aug 10 12:31:13.908140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f6e42b49-04e4-47ec-9705-a4d6411a70ad could not be found. (HTTP 404) (Request-ID: req-3f23b958-5ddf-44e1-831f-5f8d8f6d0af4) Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:13.908767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:31:13.910058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f6e42b49-04e4-47ec-9705-a4d6411a70ad could not be found. Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 12:31:13.910904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f6e42b49-04e4-47ec-9705-a4d6411a70ad could not be found. Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f6e42b49-04e4-47ec-9705-a4d6411a70ad could not be found. Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7d621c9f-b364-4971-aeca-e54fa57e8375 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Returning 404 to user: Snapshot f6e42b49-04e4-47ec-9705-a4d6411a70ad could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:31:13.917416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7d621c9f-b364-4971-aeca-e54fa57e8375 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad" status: 404 len: 111 microversion: 2.1 time: 0.063560 Aug 10 12:31:13.926813 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7e547bc0-12ba-461e-aae4-6bc24a75d6dd tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98e07c10>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:13.937624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 8/17] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:31:13 2022] GET /compute/v2.1/os-snapshots/f6e42b49-04e4-47ec-9705-a4d6411a70ad => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:31:14.132993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7e547bc0-12ba-461e-aae4-6bc24a75d6dd tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87" status: 202 len: 0 microversion: 2.1 time: 0.219621 Aug 10 12:31:14.133676 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 10/18] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:31:13 2022] DELETE /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:31:14.143038 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5ee983cf-c46f-4cd7-be99-aab10e0a7e11 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb997190d0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:14.370562 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5ee983cf-c46f-4cd7-be99-aab10e0a7e11 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87" status: 200 len: 344 microversion: 2.1 time: 0.232150 Aug 10 12:31:14.377718 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 9/19] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:31:14 2022] GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 => generated 344 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:14.578528 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e98bdb8c-bf10-4219-8762-7ce7b739f366 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98da59d0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:14.693734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e98bdb8c-bf10-4219-8762-7ce7b739f366 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/66300fcd-efda-42a9-9175-551077351b92" status: 200 len: 350 microversion: 2.1 time: 0.120554 Aug 10 12:31:14.694323 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 10/20] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:31:14 2022] GET /compute/v2.1/os-volumes/66300fcd-efda-42a9-9175-551077351b92 => generated 350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:14.708366 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f8433486-837b-4a23-8f3f-87603f373f87 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98d870d0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:14.885451 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f8433486-837b-4a23-8f3f-87603f373f87 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.182116 Aug 10 12:31:14.886020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 11/21] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 10 12:31:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:14.910123 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8aa7be14-f7b2-457b-b492-4043413b0f03 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98d0c0d0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:15.180711 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8aa7be14-f7b2-457b-b492-4043413b0f03 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.279270 Aug 10 12:31:15.190273 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 12/22] 10.222.0.65 () {58 vars in 1149 bytes} [Wed Aug 10 12:31:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:15.195994 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-148ce648-edba-4c67-844d-9784419c6db3 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98d0ca60>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:15.416647 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-148ce648-edba-4c67-844d-9784419c6db3 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.225063 Aug 10 12:31:15.417344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 13/23] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 10 12:31:15 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:15.431303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e983492b-24b4-453b-bc7a-bc0fac99052a tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98da5a60>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:15.501455 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-e983492b-24b4-453b-bc7a-bc0fac99052a tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] HTTP exception thrown: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e983492b-24b4-453b-bc7a-bc0fac99052a tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Request method failure captured: Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 HTTP/1.1 Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UFOstn6xiN93OsC8g3ayu-fSdViIF0xS8S_KyyArI7NiRDiQXN6vvu3iW4DqNPynHFxkD_TMCtLcoloLQID3XTDKLDPhR90q5-dsh0jxD8yseMLFkaHa58kJaOb_9FI8XwGr1q86-nImXyIBTy1dRTiuMVpBhYiCSTOPzl5HQ_Q0Y Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: a99cd651b5c8474fb336b307cbba38cd Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:31:15.503937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a99cd651b5c8474fb336b307cbba38cd"}]}] Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: a99cd651b5c8474fb336b307cbba38cd Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesSnapshotsTestJSON-454025635-project Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9ea99f7a48134f2b8a36f5d67c22ad51 Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-454025635-project Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'f8166002-7272-4df6-be14-688391140a87'} Aug 10 12:31:15.504955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. (HTTP 404) (Request-ID: req-f3a3d933-4456-428a-9909-f02141e2f327) Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:15.506557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:31:15.507454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 12:31:15.508365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e983492b-24b4-453b-bc7a-bc0fac99052a tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Returning 404 to user: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e983492b-24b4-453b-bc7a-bc0fac99052a tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87" status: 404 len: 109 microversion: 2.1 time: 0.078038 Aug 10 12:31:15.509443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 14/24] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:31:15 2022] GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:31:15.529704 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cbd59bc4-bb0e-42eb-a75f-1586d5741a9c tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98da59d0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:15.568658 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1517749248", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "networks": [{"uuid": "97b33311-a67f-49ac-b431-08644c8a60f1"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:15.778220 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cbd59bc4-bb0e-42eb-a75f-1586d5741a9c tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259375 Aug 10 12:31:15.779293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 15/25] 10.222.0.65 () {58 vars in 1167 bytes} [Wed Aug 10 12:31:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:15.785363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-84df337c-a084-483c-a2a9-2d19d5c34276 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98d0c9d0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:15.842704 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-84df337c-a084-483c-a2a9-2d19d5c34276 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] HTTP exception thrown: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-84df337c-a084-483c-a2a9-2d19d5c34276 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Request method failure captured: Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: DELETE /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 HTTP/1.1 Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UFOstn6xiN93OsC8g3ayu-fSdViIF0xS8S_KyyArI7NiRDiQXN6vvu3iW4DqNPynHFxkD_TMCtLcoloLQID3XTDKLDPhR90q5-dsh0jxD8yseMLFkaHa58kJaOb_9FI8XwGr1q86-nImXyIBTy1dRTiuMVpBhYiCSTOPzl5HQ_Q0Y Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: a99cd651b5c8474fb336b307cbba38cd Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:31:15.845198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a99cd651b5c8474fb336b307cbba38cd"}]}] Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: a99cd651b5c8474fb336b307cbba38cd Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesSnapshotsTestJSON-454025635-project Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9ea99f7a48134f2b8a36f5d67c22ad51 Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-454025635-project Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'f8166002-7272-4df6-be14-688391140a87'} Aug 10 12:31:15.846492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. (HTTP 404) (Request-ID: req-55ce4b57-5aec-4dc9-9a9a-521f8475b939) Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:15.847251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 12:31:15.851359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 12:31:15.852217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-84df337c-a084-483c-a2a9-2d19d5c34276 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Returning 404 to user: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-84df337c-a084-483c-a2a9-2d19d5c34276 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87" status: 404 len: 109 microversion: 2.1 time: 0.065721 Aug 10 12:31:15.853078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 16/26] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:31:15 2022] DELETE /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:31:15.858955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8d27266c-c755-450a-a4a4-c6de25be7851 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98dcdc10>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:15.908431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] validate_networks() for [('97b33311-a67f-49ac-b431-08644c8a60f1', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:31:16.050086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8d27266c-c755-450a-a4a4-c6de25be7851 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.200641 Aug 10 12:31:16.051217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 17/27] 10.222.0.65 () {58 vars in 1170 bytes} [Wed Aug 10 12:31:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:16.058469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-80f78c0d-30ee-4350-9cb3-fe079a1ef8b5 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Calling method '.version_select at 0x7fcb98d0cdc0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:16.089951 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-80f78c0d-30ee-4350-9cb3-fe079a1ef8b5 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] HTTP exception thrown: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-80f78c0d-30ee-4350-9cb3-fe079a1ef8b5 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Request method failure captured: Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 HTTP/1.1 Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UFOstn6xiN93OsC8g3ayu-fSdViIF0xS8S_KyyArI7NiRDiQXN6vvu3iW4DqNPynHFxkD_TMCtLcoloLQID3XTDKLDPhR90q5-dsh0jxD8yseMLFkaHa58kJaOb_9FI8XwGr1q86-nImXyIBTy1dRTiuMVpBhYiCSTOPzl5HQ_Q0Y Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: a99cd651b5c8474fb336b307cbba38cd Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:31:16.092086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a99cd651b5c8474fb336b307cbba38cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a99cd651b5c8474fb336b307cbba38cd"}]}] Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: a99cd651b5c8474fb336b307cbba38cd Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-454025635 Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesSnapshotsTestJSON-454025635-project Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9ea99f7a48134f2b8a36f5d67c22ad51 Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesSnapshotsTestJSON-454025635-project Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'f8166002-7272-4df6-be14-688391140a87'} Aug 10 12:31:16.093183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. (HTTP 404) (Request-ID: req-9d21311d-5051-4aed-b87c-af065ea18329) Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:16.094694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:31:16.095952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 12:31:16.096831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. Aug 10 12:31:16.100662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:31:16.108276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-80f78c0d-30ee-4350-9cb3-fe079a1ef8b5 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] Returning 404 to user: Volume f8166002-7272-4df6-be14-688391140a87 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:31:16.109583 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-80f78c0d-30ee-4350-9cb3-fe079a1ef8b5 tempest-VolumesSnapshotsTestJSON-454025635 tempest-VolumesSnapshotsTestJSON-454025635-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87" status: 404 len: 109 microversion: 2.1 time: 0.057092 Aug 10 12:31:16.112228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 18/28] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:31:16 2022] GET /compute/v2.1/os-volumes/f8166002-7272-4df6-be14-688391140a87 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:31:16.275886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-22724d29-2833-4031-a4da-aac5bc43bc99 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'create', calling method: .version_select at 0x7fcb98dcd8b0>, body: {"keypair": {"name": "tempest-keypair-1873617873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEb4S6vYVNSR41CmPGSmfWDo6Fceby4viKP1HUAkkHGFGOXyudSJavDXJdIHr1xG0pxsok58aQ0k7Z8aBgexv4CdReyLswYRWdYLV+Kro2aj3TSj4XPn58KxBDez47qaeA=="}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:16.451837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-22724d29-2833-4031-a4da-aac5bc43bc99 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Getting quotas for project 4eb5c9a17d7341d3a3dd60ef2b7a381d. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:31:16.471118 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-22724d29-2833-4031-a4da-aac5bc43bc99 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Getting quotas for user a78bd1aed509474b965592c478cb1c0c and project 4eb5c9a17d7341d3a3dd60ef2b7a381d. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:31:16.602765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-22724d29-2833-4031-a4da-aac5bc43bc99 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.481018 Aug 10 12:31:16.605911 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 19/29] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 10 12:31:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 493 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 12:31:16.617031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-061c75de-1c8c-49f8-a194-bb408ea88ca6 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb98ce58b0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:16.901217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-061c75de-1c8c-49f8-a194-bb408ea88ca6 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.290312 Aug 10 12:31:16.901930 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 20/30] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 10 12:31:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:17.363813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b97a4959-63a0-4eba-8078-1dd0aae3e34a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: .version_select at 0x7fcb98ce5af0>, body: {"keypair": {"name": "tempest-keypair-207948603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmyFiPRQ9VBq7aAq8mOYjDMekNE+mh95OhuiZqiAiKKdJUPr2wP8oBQjdRgPQWqzr9miS8YzJaH7EJlJAyTUBi+WcqtTSZn7oHxVdn74XDtozW61bJ3k1YbmliLXpCyUg=="}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:17.406434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-b97a4959-63a0-4eba-8078-1dd0aae3e34a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for project 0bbb137a895941b1876eebfc56c28425. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:31:17.415328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-b97a4959-63a0-4eba-8078-1dd0aae3e34a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for user 9b8e4aad09814f8299a334639e34d948 and project 0bbb137a895941b1876eebfc56c28425. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:31:17.477919 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b97a4959-63a0-4eba-8078-1dd0aae3e34a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.571012 Aug 10 12:31:17.489341 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 21/31] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:31:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:17.496466 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-05d261ed-05d2-4f6c-962f-a03cbbe6b260 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb984a10d0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:17.666188 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-05d261ed-05d2-4f6c-962f-a03cbbe6b260 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.175223 Aug 10 12:31:17.675207 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 22/32] 10.222.0.65 () {58 vars in 1188 bytes} [Wed Aug 10 12:31:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:18.231309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-765754322", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:18.452736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] validate_networks() for [('61402a18-53ba-4745-a9e1-e8ac1dfc87fb', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:31:18.720343 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:31:18.722802 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:31:18.724099 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:31:18.724726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:31:18.725889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:31:18.767106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:18.786279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:18.787077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:18.788156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:18.789017 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:18.792963 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:18.909046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Getting quotas for project 28eda660c33645f8a4428987084ab934. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:31:18.918699 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Getting quotas for user 94473332fd86422a9f1a1eed466f5a5a and project 28eda660c33645f8a4428987084ab934. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:31:18.935423 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:31:18.939856 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:31:19.082419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-eb328cb1-9a6d-4107-ba71-1b202289400e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.654003 Aug 10 12:31:19.083259 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 11/33] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:31:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:31:19.088617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-88ae252e-1975-4ef0-bf66-1f0e5db8d319 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] Calling method '.version_select at 0x7fcb984ac670>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:19.245379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-88ae252e-1975-4ef0-bf66-1f0e5db8d319 tempest-VolumesTestJSON-525838978 tempest-VolumesTestJSON-525838978-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.160547 Aug 10 12:31:19.257294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 12/34] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 10 12:31:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:19.257294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-959908e0-331c-407f-9333-c91f80376fe5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:19.257294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-959908e0-331c-407f-9333-c91f80376fe5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:19.756729 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-959908e0-331c-407f-9333-c91f80376fe5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:19.813426 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-959908e0-331c-407f-9333-c91f80376fe5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1215 microversion: 2.1 time: 0.565876 Aug 10 12:31:19.820684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 13/35] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:19 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1215 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:20.069687 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:31:20.070252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:31:20.070859 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:31:20.071391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:31:20.071949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:31:20.095827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:20.101337 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:20.102770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:20.111574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:20.112291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:20.112861 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:20.177686 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Getting quotas for project 2301f937213e47c29686be4e8601ac32. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:31:20.186845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Getting quotas for user 2aa6d6d56f9f4618ae3883c9beb2e77b and project 2301f937213e47c29686be4e8601ac32. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:31:20.224011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:31:20.231690 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:31:20.345840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4d36ef63-e25b-4aed-a561-b15a37c34b4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.669365 Aug 10 12:31:20.346487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 23/36] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:31:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:31:20.358554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-43a4731a-32e8-44de-9498-819f7b72c871 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:20.361018 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-43a4731a-32e8-44de-9498-819f7b72c871 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:20.843243 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4f31f433-cefc-481e-946f-edb49807bb42 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:20.844488 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4f31f433-cefc-481e-946f-edb49807bb42 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:21.054717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4f31f433-cefc-481e-946f-edb49807bb42 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:21.087379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4f31f433-cefc-481e-946f-edb49807bb42 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1215 microversion: 2.1 time: 0.255364 Aug 10 12:31:21.089433 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 24/37] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:20 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:21.220360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-43a4731a-32e8-44de-9498-819f7b72c871 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:21.255713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-43a4731a-32e8-44de-9498-819f7b72c871 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1221 microversion: 2.1 time: 0.893587 Aug 10 12:31:21.258435 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 14/38] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:20 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1221 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:21.653201 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-252525611", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:21.787469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] validate_networks() for [('61402a18-53ba-4745-a9e1-e8ac1dfc87fb', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:31:22.112272 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:22.113354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:22.153668 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:22.154242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:22.157960 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:22.162198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:22.162685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:22.163126 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:22.815960 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:22.850275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-80b31d5a-a2f7-46dc-a63b-07940394ac63 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1267 microversion: 2.1 time: 0.740034 Aug 10 12:31:22.852530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 15/39] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:22 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1267 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:23.064237 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:31:23.065453 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:31:23.066328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:31:23.066702 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:31:23.067533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:31:23.086739 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:23.088813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:23.089304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:23.090088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:23.090564 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:23.091005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:23.149416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Getting quotas for project 2301f937213e47c29686be4e8601ac32. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:31:23.160838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Getting quotas for user 2aa6d6d56f9f4618ae3883c9beb2e77b and project 2301f937213e47c29686be4e8601ac32. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:31:23.194600 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:31:23.212955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:31:23.358940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-47e41e4a-3033-4768-a8c1-f786242bfbbb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.710474 Aug 10 12:31:23.362530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 25/40] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:31:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 12:31:23.374259 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f997f8d3-c35a-48f5-aaf2-3fb3dca41e42 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:23.375105 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f997f8d3-c35a-48f5-aaf2-3fb3dca41e42 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:23.465714 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-320978680", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9747c644-617a-4b31-a63b-39dd1a5c7b9c"}], "security_groups": [{"name": "tempest-securitygroup--513970195"}], "key_name": "tempest-keypair-1873617873", "user_data": "}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:23.513223 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f997f8d3-c35a-48f5-aaf2-3fb3dca41e42 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:23.520100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f997f8d3-c35a-48f5-aaf2-3fb3dca41e42 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1221 microversion: 2.1 time: 0.150407 Aug 10 12:31:23.537780 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 16/41] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:23 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1221 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:23.874727 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:23.876109 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:23.885089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:23.889670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] validate_networks() for [('9747c644-617a-4b31-a63b-39dd1a5c7b9c', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:31:23.890712 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:23.891417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:23.892403 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:23.896229 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:23.897442 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:24.044460 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:24.055598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5091c405-0ba7-469b-aedd-f7adbaca6155 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1267 microversion: 2.1 time: 0.185627 Aug 10 12:31:24.057541 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 17/42] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:23 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:24.543786 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:24.545617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:24.558239 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:24.561388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:24.563840 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:24.564793 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:24.567012 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:24.567622 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:24.780378 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:24.801365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d4d06430-6206-44fd-878d-eb71bc2ed9f7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1225 microversion: 2.1 time: 0.261200 Aug 10 12:31:24.823193 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 18/43] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:24 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1225 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:24.929562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1630069996", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69a0d312-b2de-4689-b0c5-62b84c9112b2"}], "security_groups": [{"name": "tempest-securitygroup--845676711"}], "key_name": "tempest-keypair-207948603", "user_data": "}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:25.113195 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:31:25.113841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:31:25.114929 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:31:25.115421 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:31:25.115963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:31:25.126548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:25.127045 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:25.127553 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:25.128358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:25.128814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:25.129248 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:25.170098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Getting quotas for project 4eb5c9a17d7341d3a3dd60ef2b7a381d. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:31:25.182268 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Getting quotas for user a78bd1aed509474b965592c478cb1c0c and project 4eb5c9a17d7341d3a3dd60ef2b7a381d. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:31:25.197240 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:31:25.200123 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:31:25.288698 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] validate_networks() for [('69a0d312-b2de-4689-b0c5-62b84c9112b2', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:31:25.304130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a7f93369-0c7c-4299-a7ee-4a6b91953a28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.843179 Aug 10 12:31:25.317293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 26/44] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 10 12:31:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 12:31:25.345398 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:25.346063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:25.377129 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:25.382087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:25.383569 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:25.385047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:25.386443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:25.387040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:25.722098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:25.768524 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ba0b305d-e406-4a22-8f74-fb7475288002 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1267 microversion: 2.1 time: 0.445954 Aug 10 12:31:25.771666 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 27/45] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:25 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1267 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:25.808536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cdc8307c-94e3-4399-b6e1-cae69658cca1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:25.813097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cdc8307c-94e3-4399-b6e1-cae69658cca1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:26.452058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cdc8307c-94e3-4399-b6e1-cae69658cca1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:26.493885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cdc8307c-94e3-4399-b6e1-cae69658cca1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:26.500450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cdc8307c-94e3-4399-b6e1-cae69658cca1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:26.506512 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cdc8307c-94e3-4399-b6e1-cae69658cca1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1281 microversion: 2.20 time: 0.728099 Aug 10 12:31:26.518106 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 28/46] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:25 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1281 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:26.537645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:26.541242 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:26.560715 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:26.566304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:26.567821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:26.569418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:26.571933 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:26.575031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:26.716874 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:31:26.720271 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:31:26.722165 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:31:26.724220 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:31:26.724916 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:31:26.747372 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:26.750010 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:26.750605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:26.753000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:26.756082 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:26.756645 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:26.801180 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for project 0bbb137a895941b1876eebfc56c28425. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:31:26.811359 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for user 9b8e4aad09814f8299a334639e34d948 and project 0bbb137a895941b1876eebfc56c28425. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:31:26.830993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:31:26.834039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:31:26.918931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:26.947303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7471bb6c-c535-4c96-a919-3eee6062bec4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1273 microversion: 2.1 time: 0.424841 Aug 10 12:31:26.962361 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d767659d-e8c1-47ef-9700-d368f17222da tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.028160 Aug 10 12:31:26.963906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 29/47] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:26 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1273 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:26.984515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:26.985149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:26.985903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 19/48] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:31:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:31:27.005344 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ffd35667-427a-4230-98fc-a36f4f636ef6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:27.007896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ffd35667-427a-4230-98fc-a36f4f636ef6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:27.014712 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:27.015219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:27.021667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:27.022540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:27.023011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:27.023463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:27.136457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ffd35667-427a-4230-98fc-a36f4f636ef6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:27.146549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ffd35667-427a-4230-98fc-a36f4f636ef6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1241 microversion: 2.1 time: 0.156972 Aug 10 12:31:27.146660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 20/49] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:26 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:27.314553 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:27.325101 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c3fb540c-361c-4c56-85c8-ecd944f9d401 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1273 microversion: 2.1 time: 0.355505 Aug 10 12:31:27.334170 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 30/50] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:26 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1273 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:27.532489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:27.533114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:27.552539 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:27.568239 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:27.568700 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:27.571827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:27.584619 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:27.585088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:27.933302 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:27.943894 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:27.945497 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:27.950833 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5e546c62-325a-4b34-a8ac-69ea250f165e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1333 microversion: 2.20 time: 0.426394 Aug 10 12:31:27.964473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 21/51] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:27 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1333 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:27.972364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:27.972364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:27.980969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:27.986332 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:27.986813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:27.987561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:27.988044 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:27.988709 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:28.168277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:28.168902 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:28.198793 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:28.211500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:28.211961 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:28.212757 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:28.213198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:28.214812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:28.296403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:28.304130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cf824c13-a83d-48d7-87c5-43fe4c893f92 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1279 microversion: 2.1 time: 0.337611 Aug 10 12:31:28.304734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 31/52] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:27 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1279 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:28.355873 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:28.356529 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:28.384741 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:28.385257 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:28.385721 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:28.386447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:28.386904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:28.387329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:28.836777 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:28.856291 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b94926d8-b4f0-4072-9b18-6760b03b3a56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1245 microversion: 2.1 time: 0.688868 Aug 10 12:31:28.860820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 22/53] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:28 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1245 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:28.981665 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:28.982283 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:29.001936 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:29.006766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:29.009451 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:29.013250 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:29.016409 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-338b4e26-f60b-44fa-ba44-c8562a2fb67b tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1273 microversion: 2.1 time: 0.664663 Aug 10 12:31:29.017324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 32/54] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:28 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1273 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:29.020501 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:29.025587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:29.028343 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:29.343218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:29.343925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:29.351319 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:29.352031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:29.352764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:29.353715 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:29.354359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:29.355050 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:29.421549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:29.431932 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:29.445598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:29.447200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-05fd5040-b27a-4848-9ebb-8e0bd8940d61 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1351 microversion: 2.20 time: 0.470969 Aug 10 12:31:29.447999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 23/55] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:28 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1351 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:29.588533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:29.600922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6f3e4779-e52b-4a1a-a2a8-17fc2f85a43b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1279 microversion: 2.1 time: 0.276369 Aug 10 12:31:29.603060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 33/56] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:29 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:29.889311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:29.892083 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:29.901161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:29.907760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:29.908341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:29.912510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:29.913819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:29.916370 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:30.039080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:30.039846 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:30.054833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:30.072413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:30.073036 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:30.073927 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:30.081689 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:30.084255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:30.106750 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:30.116628 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0a358795-cbe8-4ab0-8538-c21f35adcc48 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1237 microversion: 2.1 time: 0.234373 Aug 10 12:31:30.121887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 24/57] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:29 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1237 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:30.476386 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:30.476879 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:30.482908 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:30.483638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:30.484275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:30.485223 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:30.486534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:30.487221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:30.502902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:30.515222 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a52418c8-7ff6-4d2b-91a0-946088d84aa8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.477585 Aug 10 12:31:30.516479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 34/58] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:30 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:30.611379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:30.625390 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:30.626266 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:30.641864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:30.642454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:30.643663 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:30.645358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:30.646613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-868cbfb2-ea71-487b-80f6-3c5c652d99c0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1339 microversion: 2.20 time: 0.174657 Aug 10 12:31:30.661962 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:30.662946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:30.663430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:30.663875 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:30.667207 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 25/59] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:30 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:31.147113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:31.147935 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:31.155821 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:31.156571 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:31.157170 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:31.158064 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:31.158832 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:31.159427 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:31.248327 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:31.281115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d517772b-ab87-45a0-a4b3-6e7314c05d4f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.659720 Aug 10 12:31:31.282417 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 35/60] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:30 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:31.325875 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:31.343011 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-72405fee-c38d-4490-bf2e-c58b666271e0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1237 microversion: 2.1 time: 0.198955 Aug 10 12:31:31.360156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 26/61] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:31 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1237 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:31.542072 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:31.543276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:31.548215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:31.553321 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:31.554154 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:31.555119 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:31.556570 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:31.557423 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:31.558076 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:31.680558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:31.682052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:31.703467 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:31.704681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:31.705620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:31.707142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:31.708225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:31.709097 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:31.851768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:31.865305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:31.870880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:31.875821 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dba6a857-8e83-4ab5-b1f8-dbeea4a5c634 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1339 microversion: 2.20 time: 0.204636 Aug 10 12:31:31.876544 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 27/62] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:31 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1339 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:32.005865 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:32.018400 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-378af33a-5859-4add-a8b9-c1733573174f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.481860 Aug 10 12:31:32.029590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 36/63] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:31 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:32.316573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:32.328339 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:32.367548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:32.368286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:32.369045 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:32.369755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:32.373958 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:32.375105 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:32.375749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:32.376183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:32.386820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:32.389753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:32.393623 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:32.397565 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:32.398175 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:32.399440 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:32.639168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:32.652924 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2c070708-8b9f-4f18-962e-b54d673d9acc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1237 microversion: 2.1 time: 0.290992 Aug 10 12:31:32.658332 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 37/64] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:32 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1237 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:32.903033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:32.903652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:32.917197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:32.920245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:32.920894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:32.922878 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:32.924512 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:32.926007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:33.071848 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:33.083605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f9b0b2c6-b65d-4ec5-ba65-36ba02ef54d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.785142 Aug 10 12:31:33.085940 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 28/65] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:32 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:33.112241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:33.121705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:33.152658 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:33.153091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:33.153568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:33.154305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:33.161847 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:33.162310 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:33.180100 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:33.226957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:33.234958 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:33.252665 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-50de6bb2-3990-4e5a-b60b-61fdd8378201 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1339 microversion: 2.20 time: 0.351981 Aug 10 12:31:33.253600 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 38/66] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:32 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1339 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:31:33.683351 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:33.684092 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:33.695509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:33.696416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:33.702619 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:33.704992 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:33.708066 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:33.709567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:33.886279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:33.892509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:33.902778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-afeb9d6d-2582-409a-9a8e-57721c3f1188 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.813382 Aug 10 12:31:33.903377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 29/67] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:33 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:33.913631 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1fb3e582-d017-46e7-8983-a76b99c9a7fe tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1293 microversion: 2.1 time: 0.233113 Aug 10 12:31:33.936363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 39/68] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:33 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1293 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:34.115246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:34.116817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:34.137041 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:34.143569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:34.146542 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:34.147783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:34.150820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:34.153812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:34.276664 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:34.277664 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:34.293639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:34.297528 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:34.302840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:34.303265 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:34.303579 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:34.303922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:34.585893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:34.603749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-25d44742-daeb-4c50-9c20-32e85e7a5647 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.498124 Aug 10 12:31:34.608621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 30/69] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:34 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:34.653780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:34.668428 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:34.671005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:34.676876 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-72122418-5780-43e4-b295-9ad9290a5e8d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1339 microversion: 2.20 time: 0.404985 Aug 10 12:31:34.677779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 40/70] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:34 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1339 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:34.925979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:34.926788 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:34.956942 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:34.957080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:34.957785 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:34.958965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:34.966264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:34.968665 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:34.972077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:34.973495 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:34.974717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:34.975794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:34.978248 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:34.979161 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:34.980471 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:34.987289 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:35.147963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=6 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:35.426507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:35.443855 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-898ec322-7c58-45b3-8355-e653b6560b94 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1301 microversion: 2.1 time: 0.490522 Aug 10 12:31:35.446361 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 41/71] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:34 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1301 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:35.629084 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:35.631846 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:35.658216 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:35.658718 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:35.659163 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:35.659880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:35.660338 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:35.660764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:36.108855 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:36.120952 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-db67b56a-977e-4347-bc09-36035be8ffbc tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 1.200180 Aug 10 12:31:36.121260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 31/72] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:34 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:36.148880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:36.149617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:36.172069 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:36.172865 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:36.173725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:36.175498 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:36.176240 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:36.177256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:36.483977 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=30 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:36.527548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:36.542268 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-664e0059-9126-4e56-aae9-10969754148b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.917082 Aug 10 12:31:36.544425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 42/73] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:35 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:36.554663 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:36.555419 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:36.562822 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:36.563722 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:36.564575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:36.566057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:36.566786 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:36.567410 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:36.600523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:36.672516 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:36.684278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0fa0ce61-681e-44a3-91c1-efc0347dac8e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1299 microversion: 2.1 time: 0.134663 Aug 10 12:31:36.685055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 43/74] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:36 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:36.758987 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:36.771600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:36.773245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:36.774424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ddf6208c-64b3-41bf-b35e-b5f24056351e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.636125 Aug 10 12:31:36.774999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 32/75] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:36 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:37.151957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:37.157875 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:37.175513 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.176578 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.177197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.178935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.179631 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.183673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.470684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:37.487788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b10426e9-13d3-4283-9b29-0ca8ef8ba1e5 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.344902 Aug 10 12:31:37.488982 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 44/76] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:37 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:37.564947 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:37.565745 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:37.569746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=4 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:37.570417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=20 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:37.584202 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.584751 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.585194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.585947 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.586398 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.586820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.767937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-6c030f7d-59ab-401f-bb43-44baa6bad8d9 req-39f94a24-9bc6-497b-89e5-851f897b980d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671", "tag": "54d795d2-dfea-4ba7-96f1-ce5efb7da579"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:37.786698 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6c030f7d-59ab-401f-bb43-44baa6bad8d9 req-39f94a24-9bc6-497b-89e5-851f897b980d service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.787505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6c030f7d-59ab-401f-bb43-44baa6bad8d9 req-39f94a24-9bc6-497b-89e5-851f897b980d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.788128 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6c030f7d-59ab-401f-bb43-44baa6bad8d9 req-39f94a24-9bc6-497b-89e5-851f897b980d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.811976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-6c030f7d-59ab-401f-bb43-44baa6bad8d9 req-39f94a24-9bc6-497b-89e5-851f897b980d service nova] Creating event network-changed:54d795d2-dfea-4ba7-96f1-ce5efb7da579 for instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 on hv-cinder-85226 Aug 10 12:31:37.812920 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6c030f7d-59ab-401f-bb43-44baa6bad8d9 req-39f94a24-9bc6-497b-89e5-851f897b980d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 12:31:37.814579 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6c030f7d-59ab-401f-bb43-44baa6bad8d9 req-39f94a24-9bc6-497b-89e5-851f897b980d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 12:31:37.815871 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.816520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.817209 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.818298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.818915 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.819646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.830262 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.compute.rpcapi [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 12:31:37.831658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] Releasing lock "compute-rpcapi-router" {{(pid=118379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 12:31:37.851944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-03f6c0e2-ffb9-4937-8e5f-f70cd6419234 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281234 Aug 10 12:31:37.852953 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 45/77] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:31:37.859460 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:37.861247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:37.869113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.869925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.870607 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.871773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.873140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.874046 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.911737 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:37.915826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:37.926337 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-47b3bd02-b50e-474d-bf27-0b28abb4ac2f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.361556 Aug 10 12:31:37.927415 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 33/78] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:37 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:37.932173 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:37.933008 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:37.940021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.940730 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.941341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:37.942434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:37.943177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:37.943744 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:38.055285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:38.064080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-306dd716-5ec1-49b5-bce0-675ee9bcc504 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1299 microversion: 2.1 time: 0.210063 Aug 10 12:31:38.081731 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 46/79] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:37 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1299 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:38.145586 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:38.153968 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:38.156391 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:38.158404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d14c7295-ceea-45c5-bc5b-c9149ba8b792 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.229655 Aug 10 12:31:38.159451 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 34/80] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:37 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:38.187111 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-5e29811f-7bad-4bcc-a204-33be4627476e req-057bebe6-0cd0-4188-bbc8-c091b5ebb22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0cb66da-ec40-427a-ba23-a4588100f09b", "tag": "61ba99b3-63cd-44d6-8a80-24d198d66000"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:38.197352 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-5e29811f-7bad-4bcc-a204-33be4627476e req-057bebe6-0cd0-4188-bbc8-c091b5ebb22d service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:38.197843 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-5e29811f-7bad-4bcc-a204-33be4627476e req-057bebe6-0cd0-4188-bbc8-c091b5ebb22d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:38.199229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-5e29811f-7bad-4bcc-a204-33be4627476e req-057bebe6-0cd0-4188-bbc8-c091b5ebb22d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:38.222950 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-5e29811f-7bad-4bcc-a204-33be4627476e req-057bebe6-0cd0-4188-bbc8-c091b5ebb22d service nova] Creating event network-changed:61ba99b3-63cd-44d6-8a80-24d198d66000 for instance f0cb66da-ec40-427a-ba23-a4588100f09b on hv-cinder-85226 Aug 10 12:31:38.230021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-5e29811f-7bad-4bcc-a204-33be4627476e req-057bebe6-0cd0-4188-bbc8-c091b5ebb22d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146798 Aug 10 12:31:38.234227 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 47/81] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:38.510080 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:38.510955 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:38.531679 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:38.532186 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:38.532666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:38.533434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:38.536048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:38.536392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:38.849014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:38.864696 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0b76c571-48a3-4d40-bb0b-bff7998c72e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.358639 Aug 10 12:31:38.877575 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 35/82] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:38 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:38.951860 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:38.953472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:38.973667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:38.973667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:38.973667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:38.973667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:38.973961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:38.973961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:39.088245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:39.088854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:39.106830 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:39.112034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:39.112669 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:39.113669 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:39.120323 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:39.120846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:39.262697 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:39.277600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-64b8f22e-9368-43dd-8c8d-41f7b3c7c373 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1299 microversion: 2.1 time: 0.193314 Aug 10 12:31:39.278654 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 36/83] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:39 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:39.284525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:39.285123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:39.305026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:39.305778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:39.306533 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:39.307417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:39.308091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:39.308689 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:39.528004 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:39.534246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-475e1001-6fa2-40b5-82f6-16ba8cec670b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.587720 Aug 10 12:31:39.547784 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 48/84] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:38 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:39.616378 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:39.625409 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:39.626934 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:39.628071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b1e18ab2-6ced-4891-a127-ab7239207b70 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.347132 Aug 10 12:31:39.630150 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 37/85] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:39 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:39.907001 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:39.907953 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:39.916773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:39.917559 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:39.918067 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:39.919421 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:39.919934 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:39.920430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.108150 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:40.117418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-adbb16b6-bbb1-4eec-a7df-bf104ee81318 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.215055 Aug 10 12:31:40.118364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 49/86] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:39 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:40.263993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-f00d1f00-6d65-4788-8dd0-ac164aaf597c req-456d221d-71a4-4712-aa5d-81bd2b86619b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d7d249-4da8-479b-aba1-6fcadbe4e731", "tag": "dd8cd6a6-e946-4e31-a189-f179b73d0d26"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:40.293790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f00d1f00-6d65-4788-8dd0-ac164aaf597c req-456d221d-71a4-4712-aa5d-81bd2b86619b service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.294717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f00d1f00-6d65-4788-8dd0-ac164aaf597c req-456d221d-71a4-4712-aa5d-81bd2b86619b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.296470 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f00d1f00-6d65-4788-8dd0-ac164aaf597c req-456d221d-71a4-4712-aa5d-81bd2b86619b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.308434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:40.309229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:40.319553 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.321812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.323412 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.324386 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.325896 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.326683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.366886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-f00d1f00-6d65-4788-8dd0-ac164aaf597c req-456d221d-71a4-4712-aa5d-81bd2b86619b service nova] Creating event network-changed:dd8cd6a6-e946-4e31-a189-f179b73d0d26 for instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 on hv-cinder-85226 Aug 10 12:31:40.368208 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f00d1f00-6d65-4788-8dd0-ac164aaf597c req-456d221d-71a4-4712-aa5d-81bd2b86619b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 12:31:40.369254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f00d1f00-6d65-4788-8dd0-ac164aaf597c req-456d221d-71a4-4712-aa5d-81bd2b86619b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 12:31:40.378189 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.380690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.381880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.384941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.385478 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.385924 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.423768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.compute.rpcapi [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 12:31:40.425936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 12:31:40.480476 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cfa78d5e-365d-46b1-b44f-3a8952bdd0a5 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220021 Aug 10 12:31:40.481219 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 38/87] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:40.503320 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:40.522270 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-626a5127-3a3c-4bc9-a7c4-740a71265d65 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1299 microversion: 2.1 time: 0.216958 Aug 10 12:31:40.524106 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 50/88] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:40 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:40.568802 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:40.569788 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:40.589716 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.590535 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.591191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.592642 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.593373 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.594021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.664151 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:40.669144 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:40.690516 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.692845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.693705 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.695316 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:40.698849 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:40.700433 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:40.949920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:40.959651 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-22692813-61de-42a1-8cb0-557d152ccc6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.406525 Aug 10 12:31:40.978667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 39/89] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:40 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:41.141931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:41.142513 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:41.151409 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:41.151922 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:41.152361 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:41.153068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:41.153550 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:41.153978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:41.635687 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:41.645779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:41.647160 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:41.659962 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f84fc35b-4f87-44f0-b028-118b179b9dbc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 1.000542 Aug 10 12:31:41.665228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 51/90] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:40 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:41.675191 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:41.676195 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:41.697097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:41.700089 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:41.700769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:41.701999 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:41.706276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:41.707116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:42.002456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:42.015286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a8e2b3c1-008e-4016-9e24-cf4935161849 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1299 microversion: 2.1 time: 0.348433 Aug 10 12:31:42.023208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 52/91] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:41 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1299 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:42.046505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:42.048650 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:42.079676 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:42.080213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:42.083161 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:42.097769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:42.099680 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:42.100569 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:42.376694 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:42.396175 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-227609a6-a819-4eb5-966e-9cafac928c4a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 1.258638 Aug 10 12:31:42.396687 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 40/92] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:41 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:42.684213 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:42.684951 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:42.697034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:42.697958 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:42.698648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:42.699649 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:42.700319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:42.700976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:42.769763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:42.786867 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cd0be0c9-3211-4b69-966e-1ead4d5d00d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.762556 Aug 10 12:31:42.789328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 53/93] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:42 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:43.044178 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:43.044793 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:43.053247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:43.054094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:43.055037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:43.055968 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:43.056617 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:43.057237 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:43.378843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:43.393139 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:43.397596 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:43.399191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e19ddfe-caaf-4f26-adfd-03346369af71 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.719024 Aug 10 12:31:43.401966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 41/94] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:42 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:43.425644 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:43.426780 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:43.438888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:43.446178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:43.448605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:43.450074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:43.459508 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:43.460424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:43.461890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:43.786005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:43.795103 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-447a5c7c-a4f4-4232-8778-c053dba19eb3 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.375282 Aug 10 12:31:43.811773 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 42/95] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:43 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:43.817146 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:43.818036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:43.822733 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:43.834310 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0eb2bf42-48c7-45d6-9e6e-01c6100763b2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.793564 Aug 10 12:31:43.834452 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:43.834826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:43.835259 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:43.835956 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:43.837425 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:43.837897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:43.848773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 54/96] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:43 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:44.199842 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:44.213445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-07e67395-b2ff-4dd2-9365-dcd2fb8c468e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.399591 Aug 10 12:31:44.214086 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 43/97] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:43 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:44.436578 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:44.437964 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:44.445661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:44.447256 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:44.447917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:44.448905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:44.449563 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:44.450330 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:44.695684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:44.709064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:44.711315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:44.714961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9e3ae5a2-d15a-4344-9b2f-93610bac73d0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.293240 Aug 10 12:31:44.718226 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 55/98] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:44 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:44.821341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:44.822809 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:44.836829 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:44.837555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:44.839413 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:44.840152 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:44.840623 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:44.842636 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:44.863532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:44.864184 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:44.885304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:44.888096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:44.890075 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:44.892117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:44.892538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:44.892978 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:45.167262 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:45.176404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:45.187064 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3fdc90ed-eddf-4d8c-8d2a-7b7f09c2229e tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.373902 Aug 10 12:31:45.189095 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-616bcc20-4e2a-436c-b6db-c26be9558c01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.330382 Aug 10 12:31:45.191072 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 44/99] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:44 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:45.194218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 56/100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:44 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:45.204806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-df41b4d3-26fc-4ff2-9b82-a3f598b58178 req-e84dfdf1-395c-4800-9277-45b81fdd1f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e6bf86e-2553-4f1c-8620-92c63510184a", "tag": "ee59973b-b76f-446a-a41a-885cc40ea7c3"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:45.205232 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-d44b2329-8765-4661-b54d-12d40236ecd2 req-ecb64465-2f3f-4b52-918b-34e7082dc610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2", "tag": "dd060781-b144-4d67-99d5-c6d10616e60b"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:45.227558 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-df41b4d3-26fc-4ff2-9b82-a3f598b58178 req-e84dfdf1-395c-4800-9277-45b81fdd1f06 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:45.231065 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d44b2329-8765-4661-b54d-12d40236ecd2 req-ecb64465-2f3f-4b52-918b-34e7082dc610 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:45.233310 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d44b2329-8765-4661-b54d-12d40236ecd2 req-ecb64465-2f3f-4b52-918b-34e7082dc610 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:45.233733 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-d44b2329-8765-4661-b54d-12d40236ecd2 req-ecb64465-2f3f-4b52-918b-34e7082dc610 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:45.239197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-df41b4d3-26fc-4ff2-9b82-a3f598b58178 req-e84dfdf1-395c-4800-9277-45b81fdd1f06 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:45.239757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-df41b4d3-26fc-4ff2-9b82-a3f598b58178 req-e84dfdf1-395c-4800-9277-45b81fdd1f06 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:45.252673 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-d44b2329-8765-4661-b54d-12d40236ecd2 req-ecb64465-2f3f-4b52-918b-34e7082dc610 service nova] Creating event network-changed:dd060781-b144-4d67-99d5-c6d10616e60b for instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 on hv-cinder-85226 Aug 10 12:31:45.259826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-d44b2329-8765-4661-b54d-12d40236ecd2 req-ecb64465-2f3f-4b52-918b-34e7082dc610 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066869 Aug 10 12:31:45.260643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 45/101] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:45.264663 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-df41b4d3-26fc-4ff2-9b82-a3f598b58178 req-e84dfdf1-395c-4800-9277-45b81fdd1f06 service nova] Creating event network-changed:ee59973b-b76f-446a-a41a-885cc40ea7c3 for instance 7e6bf86e-2553-4f1c-8620-92c63510184a on hv-cinder-85226 Aug 10 12:31:45.269834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:45.270725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:45.271981 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-df41b4d3-26fc-4ff2-9b82-a3f598b58178 req-e84dfdf1-395c-4800-9277-45b81fdd1f06 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076151 Aug 10 12:31:45.272646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 57/102] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:45.282842 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:45.283754 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:45.284568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:45.285612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:45.286388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:45.287315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:45.549640 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:45.558803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8f32d5c2-9cc0-4594-8adc-499cfde76ad3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.292982 Aug 10 12:31:45.559644 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 46/103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:45 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:45.744730 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:45.745469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:45.752181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:45.752870 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:45.753465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:45.754171 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:45.754731 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:45.755852 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:46.076166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:46.087721 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:46.089551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:46.090883 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1aec793e-16a9-413b-99ad-67642ab43cd8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.350915 Aug 10 12:31:46.091692 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 58/104] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:45 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:31:46.218647 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:46.218647 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:46.224674 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:46.225341 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:46.237606 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:46.238127 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:46.241666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:46.242162 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:46.242596 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:46.243033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:46.244718 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:46.245058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:46.245823 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:46.246419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:46.246998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:46.247697 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:46.430528 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:46.442521 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ec6c6c17-8e4b-4771-89d9-c112441e8038 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.233673 Aug 10 12:31:46.446250 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:46.454067 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f2c5b262-4b95-460b-b8bf-7832b5a96629 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.234528 Aug 10 12:31:46.454840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 59/105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:46 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:46.455708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 47/106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:46 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:46.579965 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:46.580695 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:46.586903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:46.587523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:46.588025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:46.589153 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:46.589637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:46.590061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:46.744072 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:46.754413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6d3434e1-bb27-4034-bd74-5cfde2fbf575 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.178155 Aug 10 12:31:46.768947 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 60/107] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:46 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:47.116436 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:47.117325 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:47.124720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:47.129644 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:47.130257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:47.131365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:47.132855 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:47.133614 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:47.463042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:47.463645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:47.472652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:47.475890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:47.476676 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:47.477584 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:47.482061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:47.482541 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:47.828000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:47.941318 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:47.953322 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:47.957998 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:47.961093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b76e20bd-cf85-48d2-8a74-df92027d1874 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.849039 Aug 10 12:31:47.963462 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 48/108] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:47 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:47.973384 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:47.978556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:47.989800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:47.991844 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:47.992493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:47.994772 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:47.996188 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:47.996889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:48.101568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:48.114704 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:48.118566 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9bfc95bd-e673-4e75-a5d2-63c8b44415c9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.659550 Aug 10 12:31:48.119413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 61/109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:47 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:48.138877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:48.142153 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:48.156292 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:48.156799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:48.157261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:48.158189 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:48.158649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:48.159070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:48.239554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:48.249615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ecde5a7f-54b5-4e1c-bf63-f935f2583de5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.283319 Aug 10 12:31:48.250794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 49/110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:47 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:48.347245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:48.356777 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cdcc540f-724f-4e79-b7dd-d6ce33890906 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.236041 Aug 10 12:31:48.358261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 62/111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:48 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:48.990600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:48.990976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:48.997549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:48.998693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:48.999550 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:49.000576 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:49.001123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:49.001786 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:49.141927 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:49.142559 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:49.154013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:49.157298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:49.158512 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:49.160363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:49.165098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:49.165596 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:49.182969 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:49.196572 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:49.198814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:49.203920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-aaecb399-7a39-4eee-befa-f91669b95c22 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.221422 Aug 10 12:31:49.210252 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 50/112] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:48 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:49.273700 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:49.274956 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:49.290770 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:49.295741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:49.296365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:49.297104 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:49.300462 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:49.301059 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:49.356916 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:49.456334 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:49.466586 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-080583a1-e894-4493-8994-6bcc32bbf1e7 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.330389 Aug 10 12:31:49.470877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 63/113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:49 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:49.490372 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:49.491028 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:49.506438 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:49.506967 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:49.514089 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:49.515336 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:49.515849 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:49.516294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:49.608218 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:49.624276 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-07e79a68-d5f8-4798-a2a7-e400caf01c6a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.356091 Aug 10 12:31:49.630985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 51/114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:49 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:49.764032 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:49.775189 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ec268f40-ad91-4639-8194-64c66b32a697 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.301055 Aug 10 12:31:49.776162 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 64/115] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:49 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:50.226825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:50.227458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:50.233580 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:50.234072 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:50.234692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:50.235392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:50.236002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:50.236602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:50.376783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:50.385055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:50.386924 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:50.388319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4bdaa827-ca48-4891-a157-26cb569f8814 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.165266 Aug 10 12:31:50.389718 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 52/116] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:50 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:31:50.487505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:50.488243 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:50.494317 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:50.494809 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:50.495249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:50.495952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:50.496411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:50.496838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:50.645502 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:50.651753 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:50.652428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:50.666880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:50.669480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:50.670487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5c7ace81-7386-4149-81e0-29361c0718eb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.179224 Aug 10 12:31:50.671590 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:50.672410 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 65/117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:50 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:50.673147 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:50.674141 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:50.674753 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:50.675372 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:50.800816 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:50.802051 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:50.813400 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:50.814871 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:50.815541 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:50.818439 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:50.819275 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:50.820259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:50.827906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:50.838443 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-86fbd1c7-c465-45d1-bdbf-65d61136d930 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.188586 Aug 10 12:31:50.851692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 53/118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:50 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:51.235486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:51.248376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-34e44ac6-696b-4096-bcac-d7167d39f88a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.451071 Aug 10 12:31:51.261302 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 66/119] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:50 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:51.414804 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:51.415358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:51.427361 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:51.428770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:51.429222 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:51.431832 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:51.432310 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:51.432736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:51.536655 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-be6fe8a9-7482-4b54-ac32-02a415dedc44 req-1d40d117-c78c-4746-98e6-93b11059031e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d7d249-4da8-479b-aba1-6fcadbe4e731", "name": "network-vif-plugged", "status": "completed", "tag": "dd8cd6a6-e946-4e31-a189-f179b73d0d26"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:51.557759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-be6fe8a9-7482-4b54-ac32-02a415dedc44 req-1d40d117-c78c-4746-98e6-93b11059031e service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:51.561227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-be6fe8a9-7482-4b54-ac32-02a415dedc44 req-1d40d117-c78c-4746-98e6-93b11059031e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:51.561857 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-be6fe8a9-7482-4b54-ac32-02a415dedc44 req-1d40d117-c78c-4746-98e6-93b11059031e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:51.610920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-be6fe8a9-7482-4b54-ac32-02a415dedc44 req-1d40d117-c78c-4746-98e6-93b11059031e service nova] Creating event network-vif-plugged:dd8cd6a6-e946-4e31-a189-f179b73d0d26 for instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 on hv-cinder-85226 Aug 10 12:31:51.620090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-be6fe8a9-7482-4b54-ac32-02a415dedc44 req-1d40d117-c78c-4746-98e6-93b11059031e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226550 Aug 10 12:31:51.621098 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 54/120] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:51.696816 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:51.698200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:51.718906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:51.720607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:51.722785 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:51.730094 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:51.731361 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:51.733474 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:51.955998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:51.965169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:51.970210 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:51.973738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7ec86756-f6ac-484f-bc93-e949d3fefbb4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.562864 Aug 10 12:31:51.974411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:51.976464 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 67/121] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:51 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:51.989565 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bdb0e0f2-518f-498f-8dfc-1e01c919acc8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.292061 Aug 10 12:31:51.989565 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 55/122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:51 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:51.993059 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:51.993702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:52.004351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:52.004850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:52.005306 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:52.006015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:52.006491 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:52.006913 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:52.165092 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:52.174381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-94a00da7-101f-4f89-9acc-56a2d5a63db0 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.190020 Aug 10 12:31:52.175735 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 56/123] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:51 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:52.273166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:52.273820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:52.279912 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:52.280667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:52.281179 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:52.282240 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:52.282728 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:52.283461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:52.446217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:52.455388 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a7c57f2f-76a3-4055-b8fa-a4a465bca1a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.187026 Aug 10 12:31:52.457736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 68/124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:52 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:53.005385 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:53.006195 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:53.007364 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:53.008506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:53.022864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.025665 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.026500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.027292 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.027973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.030132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.030667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.032155 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.033697 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.035148 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.035456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.038845 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.359592 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:53.359950 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:53.369032 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-027d001c-2d61-42aa-82ca-1e494a5940c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.368874 Aug 10 12:31:53.370430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 69/125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:52 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:53.371111 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:53.375422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:53.377826 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:53.378760 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:53.380168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1f026aa5-9a54-4f4b-b05a-1f330d8176e9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.384916 Aug 10 12:31:53.387383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.388246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.389595 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.390681 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.391416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.392060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.395755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 57/126] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:52 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:53.476848 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:53.477767 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:53.495514 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.499703 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.502206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.505469 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.506879 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.508493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.613078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:53.625658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5f7b65ff-2236-456d-97b6-c08d3386a426 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.253615 Aug 10 12:31:53.635282 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 70/127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:53 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:53.655362 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-f34df8a9-6f51-41df-8f58-056659625b18 req-56d15fac-9fb7-4f9f-a559-2dae103d96f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cb66da-ec40-427a-ba23-a4588100f09b", "name": "network-vif-plugged", "status": "completed", "tag": "61ba99b3-63cd-44d6-8a80-24d198d66000"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:53.666246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-f34df8a9-6f51-41df-8f58-056659625b18 req-56d15fac-9fb7-4f9f-a559-2dae103d96f5 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:53.666978 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-f34df8a9-6f51-41df-8f58-056659625b18 req-56d15fac-9fb7-4f9f-a559-2dae103d96f5 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:53.667201 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-f34df8a9-6f51-41df-8f58-056659625b18 req-56d15fac-9fb7-4f9f-a559-2dae103d96f5 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:53.695293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-f34df8a9-6f51-41df-8f58-056659625b18 req-56d15fac-9fb7-4f9f-a559-2dae103d96f5 service nova] Creating event network-vif-plugged:61ba99b3-63cd-44d6-8a80-24d198d66000 for instance f0cb66da-ec40-427a-ba23-a4588100f09b on hv-cinder-85226 Aug 10 12:31:53.703370 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-f34df8a9-6f51-41df-8f58-056659625b18 req-56d15fac-9fb7-4f9f-a559-2dae103d96f5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067728 Aug 10 12:31:53.704453 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 71/128] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:53.786915 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:53.796392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8ae91c24-213d-423d-a35c-75f53c5388b8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.323853 Aug 10 12:31:53.809854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 58/129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:53 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:54.393800 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:54.394499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:54.400502 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:54.401185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:54.401641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:54.402324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:54.402773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:54.403189 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:54.406658 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:54.407816 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:54.414080 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:54.414790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:54.415411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:54.416298 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:54.416948 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:54.417860 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:54.552152 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:54.560850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:54.562377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:54.563498 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7591f1c3-8e94-4e9d-837c-4e34208af716 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.161570 Aug 10 12:31:54.564050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 59/130] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:54 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:54.584608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:54.595087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b3087242-5c56-4eb3-bc32-306f78204717 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.204680 Aug 10 12:31:54.606607 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 72/131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:54 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:54.651536 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:54.652239 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:54.665670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:54.665670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:54.665670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:54.665670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:54.665962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:54.665962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:54.813777 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:54.819276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:54.819909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:54.825854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9eb47b14-38fd-42bb-b236-72eb9ea19649 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.179293 Aug 10 12:31:54.826646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:54.827535 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 60/132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:54 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:54.840339 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:54.841096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:54.842274 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:54.842812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:54.843239 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:54.978524 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:54.985922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d740021f-72dc-41a9-b675-e4c5c024ad9d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.170744 Aug 10 12:31:54.986618 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 73/133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:54 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:55.585454 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:55.586067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:55.592537 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:55.593034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:55.593505 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:55.594203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:55.594660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:55.595086 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:55.617502 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:55.618646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:55.625050 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:55.625692 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:55.626281 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:55.627391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:55.627936 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:55.628479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:55.753228 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:55.762948 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:55.764872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:55.766246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-70694aba-0cf7-4a38-aa93-4a9766deb9fb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.184651 Aug 10 12:31:55.767018 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 61/134] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:55 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:55.785459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:55.793575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c03ea693-a8ea-499f-88e7-3083ab9ae80d tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.179878 Aug 10 12:31:55.794168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 74/135] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:55 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:55.848420 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:55.849361 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:55.858215 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:55.858949 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:55.859477 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:55.860358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:55.861225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:55.861741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:55.998707 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:56.006186 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8633df48-5992-4166-86b5-354eb05f520a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.162207 Aug 10 12:31:56.006845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:56.007226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 62/136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:55 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:56.014778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:56.021969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:56.022456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:56.022891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:56.023762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:56.024248 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:56.024677 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:56.160786 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:56.168625 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-76ba8690-4900-4fd7-b26c-fba01b39b202 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.165588 Aug 10 12:31:56.169291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 75/137] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:56 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:56.788696 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:56.789485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:56.797156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:56.797717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:56.798748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:56.799789 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:56.800247 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:56.800675 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:56.817816 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:56.818507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:56.825758 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:56.826360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:56.826952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:56.827990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:56.828513 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:56.829137 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:56.947614 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:56.956561 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:56.958122 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:56.959228 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a33c7470-1f62-43f4-838d-302caac7112e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.174596 Aug 10 12:31:56.960246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 63/138] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:56 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:56.977013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:56.983236 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-01fb00c6-cbd9-47e0-94f0-3e16ba8661b9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.171116 Aug 10 12:31:56.983791 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 76/139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:56 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:57.027318 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:57.027958 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:57.034374 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:57.034846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:57.035284 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:57.035951 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:57.036399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:57.036814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:57.162821 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:57.170664 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ce61a97f-4f82-476d-9c16-c05075e9f968 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.147127 Aug 10 12:31:57.171224 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 64/140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:57 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:57.188864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:57.189536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:57.195498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:57.195982 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:57.196415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:57.197101 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:57.197583 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:57.198004 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:57.326419 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:57.334114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-92ea5c7d-5007-469b-a2bb-2da96156e6b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.149038 Aug 10 12:31:57.334677 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 77/141] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:57 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:57.981400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:57.982004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:57.987976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:57.988455 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:57.988886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:57.989592 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:57.990037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:57.990453 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:58.004692 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:58.005437 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:58.013182 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:58.014332 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:58.014872 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:58.015673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:58.016251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:58.016748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:58.125720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:58.134019 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:58.135660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:58.136768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d376ccf1-4747-4dfe-8132-777fd489c6d3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.159304 Aug 10 12:31:58.137570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 65/142] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:57 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:58.166250 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:58.174171 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ef206748-64ac-48fe-a084-980764ddc6d9 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1315 microversion: 2.1 time: 0.173568 Aug 10 12:31:58.174742 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 78/143] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:57 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:58.191507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:58.192206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:58.198121 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:58.198926 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:58.199555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:58.200261 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:58.200806 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:58.201241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:58.247734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-6acb168a-48fc-4ce3-b9f0-fcbe2dd37e60 req-48d8a4ee-8a89-4d3d-ae79-8f2abcfe33fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671", "name": "network-vif-plugged", "status": "completed", "tag": "54d795d2-dfea-4ba7-96f1-ce5efb7da579"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:58.259168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6acb168a-48fc-4ce3-b9f0-fcbe2dd37e60 req-48d8a4ee-8a89-4d3d-ae79-8f2abcfe33fc service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:58.259876 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6acb168a-48fc-4ce3-b9f0-fcbe2dd37e60 req-48d8a4ee-8a89-4d3d-ae79-8f2abcfe33fc service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:58.260461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6acb168a-48fc-4ce3-b9f0-fcbe2dd37e60 req-48d8a4ee-8a89-4d3d-ae79-8f2abcfe33fc service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:58.265324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:58.275031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-6acb168a-48fc-4ce3-b9f0-fcbe2dd37e60 req-48d8a4ee-8a89-4d3d-ae79-8f2abcfe33fc service nova] Creating event network-vif-plugged:54d795d2-dfea-4ba7-96f1-ce5efb7da579 for instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 on hv-cinder-85226 Aug 10 12:31:58.282195 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-6acb168a-48fc-4ce3-b9f0-fcbe2dd37e60 req-48d8a4ee-8a89-4d3d-ae79-8f2abcfe33fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038572 Aug 10 12:31:58.283390 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 79/144] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:31:58.338580 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:58.350525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6da99113-c963-4d4f-a7ca-970b82b9acdb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.162681 Aug 10 12:31:58.353212 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 66/145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:58 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:58.367323 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:58.368032 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:58.374809 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:58.375295 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:58.375764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:58.376454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:58.377071 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:58.377520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:58.518427 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:58.528633 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2fe32e5c-018b-46f4-9991-c0d540f4f900 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1321 microversion: 2.1 time: 0.165752 Aug 10 12:31:58.529918 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 80/146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:58 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:59.161062 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:59.162934 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:59.169429 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.170202 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.170901 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.171820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.172545 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.173118 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.196047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:59.197357 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:59.207776 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.210434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.211057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.211935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.212538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.213112 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.417918 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:59.429078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c05dbb2e-f0a5-4018-8ec5-ba26a6323aab tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1502 microversion: 2.1 time: 0.236739 Aug 10 12:31:59.430167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 81/147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:59 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:31:59.436485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:59.437523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:59.474587 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.476020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.477257 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.479222 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.481018 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.482557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.484965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:59.499273 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:59.504230 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:59.507082 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-18c851c4-70a1-4431-988a-4c78c8854348 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.350051 Aug 10 12:31:59.508002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 67/148] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:31:59 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:31:59.551972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:31:59.553385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:59.562071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.563424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.564073 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.566400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.568055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.570290 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.835211 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:59.840079 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:31:59.844860 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cbcae35a-1031-48b7-8454-945001a039d1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.413558 Aug 10 12:31:59.845877 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:31:59.846006 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 82/149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:59 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:59.852100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-815b076c-02ba-472c-9c57-8bcf3ce30ca1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1515 microversion: 2.1 time: 0.303817 Aug 10 12:31:59.852843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 68/150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:31:59 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:31:59.880051 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:31:59.882422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:31:59.888806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.889558 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.890191 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.891085 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:31:59.891682 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:31:59.892246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:31:59.959297 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lazy-loading 'flavor' on Instance uuid 15d7d249-4da8-479b-aba1-6fcadbe4e731 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:32:00.132411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a1c9c7c3-0a7c-43f9-8842-9575df99ab67 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731/action" status: 200 len: 32 microversion: 2.1 time: 0.255731 Aug 10 12:32:00.137528 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 83/151] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:31:59 2022] POST /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:32:00.143606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:00.144510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:00.157002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:00.157863 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:00.158608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:00.159470 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:00.161984 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:00.174053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:00.319854 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-ac947d87-1da8-4b19-be2a-66ad49767f02 req-3c7a445c-c129-4ee7-8dad-9bc09297369c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e6bf86e-2553-4f1c-8620-92c63510184a", "name": "network-vif-plugged", "status": "completed", "tag": "ee59973b-b76f-446a-a41a-885cc40ea7c3"}, {"server_uuid": "b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2", "name": "network-vif-plugged", "status": "completed", "tag": "dd060781-b144-4d67-99d5-c6d10616e60b"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:00.344031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ac947d87-1da8-4b19-be2a-66ad49767f02 req-3c7a445c-c129-4ee7-8dad-9bc09297369c service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:00.344886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ac947d87-1da8-4b19-be2a-66ad49767f02 req-3c7a445c-c129-4ee7-8dad-9bc09297369c service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:00.347071 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ac947d87-1da8-4b19-be2a-66ad49767f02 req-3c7a445c-c129-4ee7-8dad-9bc09297369c service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:00.379720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:00.388069 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a04fd669-77ca-42e9-9ff6-0abe2a748391 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.248675 Aug 10 12:32:00.388253 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-ac947d87-1da8-4b19-be2a-66ad49767f02 req-3c7a445c-c129-4ee7-8dad-9bc09297369c service nova] Creating event network-vif-plugged:ee59973b-b76f-446a-a41a-885cc40ea7c3 for instance 7e6bf86e-2553-4f1c-8620-92c63510184a on hv-cinder-85226 Aug 10 12:32:00.393337 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-ac947d87-1da8-4b19-be2a-66ad49767f02 req-3c7a445c-c129-4ee7-8dad-9bc09297369c service nova] Creating event network-vif-plugged:dd060781-b144-4d67-99d5-c6d10616e60b for instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 on hv-cinder-85226 Aug 10 12:32:00.393577 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 69/152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:00 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:00.396229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-ac947d87-1da8-4b19-be2a-66ad49767f02 req-3c7a445c-c129-4ee7-8dad-9bc09297369c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091742 Aug 10 12:32:00.396902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 84/153] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:32:00.539987 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:00.540586 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:00.549128 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:00.549754 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:00.550194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:00.550973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:00.551372 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:00.552124 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:00.827153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:00.844764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:00.851643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:00.854765 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b87703fc-3005-42a2-9733-95aca5524d47 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.317586 Aug 10 12:32:00.858180 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 70/154] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:32:00 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:32:00.892494 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:00.896062 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:00.928797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:00.929403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:00.931969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:00.936461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:00.937476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:00.941800 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:01.166481 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:01.176815 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4c43afab-1e39-43c3-bad3-d9a6eec25beb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.299129 Aug 10 12:32:01.177734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 85/155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:00 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:01.247379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52557f37-2555-43ca-a22d-e59bc2222cf5"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:01.250511 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:01.256715 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:01.257455 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:01.258095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:01.258887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:01.259555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:01.260198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:01.409045 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:01.409685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:01.421436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:01.434653 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:01.437158 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:01.437823 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:01.438824 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:01.439540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:01.440758 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:01.787258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:01.798897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7b87de2a-46a9-4c82-a943-0aaf2f874914 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.392804 Aug 10 12:32:01.812191 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 86/156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:01 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:01.825554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-be56b444-3819-4487-a92b-e576e44a8ef8 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "POST /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.582513 Aug 10 12:32:01.827477 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 71/157] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:32:01 2022] POST /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:32:01.881004 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:01.881824 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:01.888076 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:01.888838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:01.890359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:01.894297 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:01.894922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:01.896277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:02.047460 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:02.055286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:02.056851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:02.058039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a51f0492-a6bb-41ac-b451-72eaae0bfbde tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.181431 Aug 10 12:32:02.058590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 87/158] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:32:01 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:32:02.203130 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:02.204327 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:02.212389 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:02.213007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:02.213575 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:02.214378 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:02.214968 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:02.215588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:02.420800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:02.429312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-717c5836-a4b3-48e3-acb2-1fdeefa10f7b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.233302 Aug 10 12:32:02.443513 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 72/159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:02 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:02.821429 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:02.822765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:02.828861 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:02.829390 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:02.829849 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:02.830597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:02.830958 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:02.831383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:03.022664 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:03.032564 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-dd1c6bba-2dee-49c3-8618-685768379341 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.215113 Aug 10 12:32:03.047704 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 88/160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:02 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:03.084606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:03.085287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:03.099888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:03.101095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:03.102468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:03.105583 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:03.106417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:03.106826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:03.336955 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:03.348913 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:03.351375 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:03.353096 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-07338837-698a-4265-a268-a84387202c68 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1406 microversion: 2.20 time: 0.273381 Aug 10 12:32:03.370745 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 73/161] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:32:03 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:32:03.458050 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:03.459487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:03.480320 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:03.480896 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:03.481470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:03.482230 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:03.484256 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:03.485869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:03.888795 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:03.899685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ce83762c-36b4-4efa-a4e8-79445f196177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1366 microversion: 2.1 time: 0.452973 Aug 10 12:32:03.909827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 89/162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:03 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:04.056351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:04.057802 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:04.066226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:04.067007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:04.067660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:04.068591 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:04.069749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:04.070387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:04.239469 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:04.251163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-32c6048c-b0b1-4a11-88bd-51838b24f64a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.199658 Aug 10 12:32:04.252195 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 74/163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:04 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:04.380430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:04.381046 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:04.390041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:04.394007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:04.395689 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:04.396608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:04.397295 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:04.397910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:04.603995 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:04.612443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:04.614364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:04.615839 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b56a52c8-892f-4f43-b6f5-6c14af55ea23 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1596 microversion: 2.20 time: 0.239443 Aug 10 12:32:04.630894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 90/164] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:32:04 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1596 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:32:04.643081 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:04.644338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:04.652398 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:04.652971 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:04.653521 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:04.655836 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:04.656503 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:04.657020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:04.794289 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7f4aa00f-8686-4920-9455-c00ca40c984d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.156572 Aug 10 12:32:04.803153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 75/165] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 10 12:32:04 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:32:04.923206 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:04.924013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:04.932075 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:04.933041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:04.933879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:04.934892 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:04.936210 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:04.936973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:05.192784 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:05.203303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-bb322531-af5d-45ce-9eb6-0b5ec99eef46 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1556 microversion: 2.1 time: 0.284928 Aug 10 12:32:05.203874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 91/166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:04 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1556 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:05.226131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:05.226756 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:05.235669 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:05.240141 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:05.240846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:05.241849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:05.242507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:05.244012 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:05.273916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:05.275276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:05.287825 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:05.291027 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:05.293190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:05.297173 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:05.299345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:05.299817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:05.555618 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:05.558621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0e44e2c3-85b2-4554-8bd6-2e238cb5afb8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.337539 Aug 10 12:32:05.559605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 76/167] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 10 12:32:05 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-interface => generated 284 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:32:05.574582 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3b8610c4-22f0-4699-ab9f-d9c681e196e6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.304740 Aug 10 12:32:05.576740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 92/168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:05 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:06.548100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-0107f7da-d45e-43a8-94ec-75099ee3a2f8 req-d7e3458f-4d55-4c98-a8c7-58a2c1e163aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2", "tag": "dd060781-b144-4d67-99d5-c6d10616e60b"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:06.562944 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-0107f7da-d45e-43a8-94ec-75099ee3a2f8 req-d7e3458f-4d55-4c98-a8c7-58a2c1e163aa service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:06.563815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-0107f7da-d45e-43a8-94ec-75099ee3a2f8 req-d7e3458f-4d55-4c98-a8c7-58a2c1e163aa service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:06.564413 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-0107f7da-d45e-43a8-94ec-75099ee3a2f8 req-d7e3458f-4d55-4c98-a8c7-58a2c1e163aa service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:06.588891 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-0107f7da-d45e-43a8-94ec-75099ee3a2f8 req-d7e3458f-4d55-4c98-a8c7-58a2c1e163aa service nova] Creating event network-changed:dd060781-b144-4d67-99d5-c6d10616e60b for instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 on hv-cinder-85226 Aug 10 12:32:06.603405 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:06.604171 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:06.615915 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-0107f7da-d45e-43a8-94ec-75099ee3a2f8 req-d7e3458f-4d55-4c98-a8c7-58a2c1e163aa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071560 Aug 10 12:32:06.617041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:06.617802 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 77/169] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:32:06.621278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:06.621969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:06.622945 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:06.623408 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:06.623830 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:07.118326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:07.127290 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b463b112-b0b4-49f8-b253-15cd6f3fb216 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.532064 Aug 10 12:32:07.142376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 93/170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:06 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:08.151906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:08.153379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:08.163246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:08.164631 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:08.165401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:08.166963 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:08.167752 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:08.168811 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:08.180274 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-d7019032-c21c-4b47-a08e-c3d0cc62998b req-41e78189-f2f0-48e8-9c78-28c87d13582a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e6bf86e-2553-4f1c-8620-92c63510184a", "tag": "ee59973b-b76f-446a-a41a-885cc40ea7c3"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:08.191317 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d7019032-c21c-4b47-a08e-c3d0cc62998b req-41e78189-f2f0-48e8-9c78-28c87d13582a service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:08.211189 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d7019032-c21c-4b47-a08e-c3d0cc62998b req-41e78189-f2f0-48e8-9c78-28c87d13582a service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:08.211758 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d7019032-c21c-4b47-a08e-c3d0cc62998b req-41e78189-f2f0-48e8-9c78-28c87d13582a service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:08.238841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-d7019032-c21c-4b47-a08e-c3d0cc62998b req-41e78189-f2f0-48e8-9c78-28c87d13582a service nova] Creating event network-changed:ee59973b-b76f-446a-a41a-885cc40ea7c3 for instance 7e6bf86e-2553-4f1c-8620-92c63510184a on hv-cinder-85226 Aug 10 12:32:08.245187 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-d7019032-c21c-4b47-a08e-c3d0cc62998b req-41e78189-f2f0-48e8-9c78-28c87d13582a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070170 Aug 10 12:32:08.246385 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 94/171] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:32:08.664512 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:08.690815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e57cdb5-e83f-4c75-aed5-ff19bebee535 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.539673 Aug 10 12:32:08.691920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 78/172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:08 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:09.712812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:09.717462 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:09.726136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:09.729841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:09.730373 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:09.732634 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:09.733843 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:09.737683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:09.956262 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:09.960650 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:09.968552 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3178fd0e-808b-45a2-ab92-9a3fe7b42634 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.258376 Aug 10 12:32:09.968552 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 95/173] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:09 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:10.987992 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:10.988802 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:10.997199 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:10.997844 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:10.998344 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:10.999338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:10.999861 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:11.000548 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:11.155667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:11.165046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4fd95b0f-d19f-4efd-aee7-662a2e4203b0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.181000 Aug 10 12:32:11.169842 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 79/174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:10 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:12.185496 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:12.186108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:12.192927 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:12.193491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:12.193938 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:12.194642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:12.195102 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:12.195534 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:12.323278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:12.330723 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ca4606ed-b1e9-49b3-8560-2a8555cc06fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.149433 Aug 10 12:32:12.331290 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 96/175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:12 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:13.354349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:13.356525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:13.366824 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:13.367321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:13.367763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:13.368473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:13.368939 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:13.369387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:13.520834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:13.529377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-29b11796-f258-4ec8-bada-c08a5d53e1f0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.180105 Aug 10 12:32:13.543600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 80/176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:13 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:14.555142 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:14.556413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:14.565248 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:14.566126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:14.566572 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:14.567310 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:14.567946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:14.568926 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:14.745449 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:14.746528 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d6f71dab-1b27-4c56-8f5d-ae0d05a4f425 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.200469 Aug 10 12:32:14.747071 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 97/177] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:14 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:15.253570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:15.254119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:15.256422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=78 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:15.261631 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:15.262123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:15.262576 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:15.263291 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:15.263746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:15.264204 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:15.293940 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:32:15.384749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-671ce447-28fa-49f5-9317-cc3ed49b9b0a tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 204 len: 0 microversion: 2.1 time: 0.134564 Aug 10 12:32:15.385387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 81/178] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:32:15 2022] DELETE /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:32:15.393500 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:15.394109 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:15.400232 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:15.400710 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:15.401138 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:15.401850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:15.402307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:15.402720 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:15.533906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:15.542266 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b31c4152-6aa0-437a-9cd0-00ae4cd938bb tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1554 microversion: 2.1 time: 0.152634 Aug 10 12:32:15.542819 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 98/179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:15 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:15.770396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:15.771314 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:15.777658 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:15.778242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:15.779324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:15.780048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:15.780498 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:15.781034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:15.939838 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:15.947473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-48fad77d-b34f-4576-805e-dca2e5abb56b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.181195 Aug 10 12:32:15.948114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 82/180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:15 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:16.566474 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:16.567181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:16.576761 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:16.577638 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:16.577853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:16.578969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:16.579657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:16.580215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:16.755793 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:16.763901 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f6747fc0-9a7e-4e0d-8431-5fbcdb6ec300 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1554 microversion: 2.1 time: 0.205171 Aug 10 12:32:16.764543 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 99/181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:16 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:16.970207 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:16.970814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:16.977857 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:16.978644 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:16.979273 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:16.980158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:16.980615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:16.981198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:17.132009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:17.135561 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:17.140804 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f91aa4e1-7a4c-4f58-8c4f-4d4fac4482ae tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.175091 Aug 10 12:32:17.141941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 83/182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:16 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:17.787968 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:17.788785 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:17.804354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:17.806013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:17.806810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:17.807574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:17.808031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:17.808873 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:18.017667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:18.020917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7801d058-c85e-4222-97f5-8afa8aff3434 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1554 microversion: 2.1 time: 0.239060 Aug 10 12:32:18.022130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 100/183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:17 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:18.164053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:18.166790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:18.174681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:18.175402 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:18.176019 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:18.176930 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:18.177564 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:18.179038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:18.339894 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:18.347969 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d9f5a74c-8433-4896-af59-11ab13855732 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.189096 Aug 10 12:32:18.363304 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 84/184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:18 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:19.046365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:19.047661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:19.056414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:19.057417 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:19.058348 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:19.060074 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:19.060697 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:19.061316 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:19.372108 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:19.373254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:19.386544 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:19.388298 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:19.392060 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:19.394605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:19.397051 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:19.398515 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:19.566206 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:19.586304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-73cadf2f-4cea-4ccf-8362-d29775e23502 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1554 microversion: 2.1 time: 0.543455 Aug 10 12:32:19.597735 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 101/185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:19 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1554 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:19.741528 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:19.752990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cab5afd7-e2bc-4f6e-a2a7-a81104bf8c3b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.384952 Aug 10 12:32:19.755976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 85/186] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:19 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:19.800877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-5c8cfd50-2a88-4665-8546-f16947339cfb req-ef98f74c-4949-47ca-a65e-fa26f114713d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0cb66da-ec40-427a-ba23-a4588100f09b", "name": "network-vif-deleted", "tag": "61ba99b3-63cd-44d6-8a80-24d198d66000"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:19.813088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-5c8cfd50-2a88-4665-8546-f16947339cfb req-ef98f74c-4949-47ca-a65e-fa26f114713d service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:19.813591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-5c8cfd50-2a88-4665-8546-f16947339cfb req-ef98f74c-4949-47ca-a65e-fa26f114713d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:19.814285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-5c8cfd50-2a88-4665-8546-f16947339cfb req-ef98f74c-4949-47ca-a65e-fa26f114713d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:19.826685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-5c8cfd50-2a88-4665-8546-f16947339cfb req-ef98f74c-4949-47ca-a65e-fa26f114713d service nova] Creating event network-vif-deleted:61ba99b3-63cd-44d6-8a80-24d198d66000 for instance f0cb66da-ec40-427a-ba23-a4588100f09b on hv-cinder-85226 Aug 10 12:32:19.832341 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-5c8cfd50-2a88-4665-8546-f16947339cfb req-ef98f74c-4949-47ca-a65e-fa26f114713d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035179 Aug 10 12:32:19.833541 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 102/187] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:32:20.611722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:20.612542 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:20.626221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:20.626732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:20.627171 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:20.628056 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:20.629349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:20.631217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:20.722617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94473332fd86422a9f1a1eed466f5a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28eda660c33645f8a4428987084ab934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:20.730773 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7ed190f1-c406-4bbf-b3b0-c0b2f7db7010 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 200 len: 1346 microversion: 2.1 time: 0.125073 Aug 10 12:32:20.731338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 86/188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:20 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 1346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:20.780747 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:20.782377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:20.789742 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:20.790483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:20.790917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:20.791660 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:20.792323 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:20.792745 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:20.995678 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:21.005563 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-edb55908-cbac-4d5d-b9e0-8a1bd215d14b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.231120 Aug 10 12:32:21.006473 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 103/189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:20 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:21.753022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:21.753967 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:21.762508 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:21.763173 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:21.763780 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:21.764457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:21.764929 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:21.765399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:21.779500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] HTTP exception thrown: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Request method failure captured: Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b HTTP/1.1 Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86URWY6yCw56GCnAR4hKQMzqwqh9vJD0lu2KpRaTrOlJCtTIkEroV-QutfCGHEHOYBKGRu9SSOo9PBsfobzgGg3ZMxHh3tS8RgM3bA7MJCmIjAxZ7dVs8dApEx2SCzsnSMceTMPqwjeFHgQJ2fBIo6EA1Wm4tfF-pszIcL9lBioQbk8 Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 28eda660c33645f8a4428987084ab934 Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:32:21.784966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28eda660c33645f8a4428987084ab934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_28eda660c33645f8a4428987084ab934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/28eda660c33645f8a4428987084ab934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28eda660c33645f8a4428987084ab934"}]}] Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 28eda660c33645f8a4428987084ab934 Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-DeleteServersTestJSON-1561437683-project Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 94473332fd86422a9f1a1eed466f5a5a Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-DeleteServersTestJSON-1561437683-project Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.786438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'f0cb66da-ec40-427a-ba23-a4588100f09b'} Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:32:21.787260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.788525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.789719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Returning 404 to user: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:32:21.789719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-356c3140-6bc3-430a-9ac9-011297fb90c1 tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 404 len: 111 microversion: 2.1 time: 0.040929 Aug 10 12:32:21.790067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 87/190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:21 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:32:21.905359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:21.907492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:21.913311 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:21.913845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:21.914288 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:21.915012 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:21.915472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:21.915900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:21.933864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] HTTP exception thrown: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Request method failure captured: Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b/os-volume_attachments HTTP/1.1 Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86URWY6yCw56GCnAR4hKQMzqwqh9vJD0lu2KpRaTrOlJCtTIkEroV-QutfCGHEHOYBKGRu9SSOo9PBsfobzgGg3ZMxHh3tS8RgM3bA7MJCmIjAxZ7dVs8dApEx2SCzsnSMceTMPqwjeFHgQJ2fBIo6EA1Wm4tfF-pszIcL9lBioQbk8 Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 28eda660c33645f8a4428987084ab934 Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:32:21.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28eda660c33645f8a4428987084ab934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_28eda660c33645f8a4428987084ab934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/28eda660c33645f8a4428987084ab934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28eda660c33645f8a4428987084ab934"}]}] Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 28eda660c33645f8a4428987084ab934 Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-DeleteServersTestJSON-1561437683-project Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 94473332fd86422a9f1a1eed466f5a5a Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-DeleteServersTestJSON-1561437683-project Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.943779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'server_id': 'f0cb66da-ec40-427a-ba23-a4588100f09b'} Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:32:21.944415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:21.945470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:21.946518 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Returning 404 to user: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:32:21.946518 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8bc93cf9-86b8-4bdf-a736-346d5890fead tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042829 Aug 10 12:32:21.946518 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 104/191] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:32:21 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:32:22.028180 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:22.029039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:22.044962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:22.046783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:22.047241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:22.048867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:22.049469 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:22.050366 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:22.211849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:22.219627 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4d7092b5-46ad-4ae4-9a0e-99e2de6c4404 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.195957 Aug 10 12:32:22.220186 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 88/192] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:22 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:23.196915 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:23.198289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:23.205261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:23.205893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:23.206358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:23.207119 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:23.207944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:23.208439 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:23.223231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] HTTP exception thrown: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Request method failure captured: Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: DELETE /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b HTTP/1.1 Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86URWY6yCw56GCnAR4hKQMzqwqh9vJD0lu2KpRaTrOlJCtTIkEroV-QutfCGHEHOYBKGRu9SSOo9PBsfobzgGg3ZMxHh3tS8RgM3bA7MJCmIjAxZ7dVs8dApEx2SCzsnSMceTMPqwjeFHgQJ2fBIo6EA1Wm4tfF-pszIcL9lBioQbk8 Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 28eda660c33645f8a4428987084ab934 Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:32:23.225644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28eda660c33645f8a4428987084ab934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_28eda660c33645f8a4428987084ab934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/28eda660c33645f8a4428987084ab934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28eda660c33645f8a4428987084ab934"}]}] Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 28eda660c33645f8a4428987084ab934 Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-DeleteServersTestJSON-1561437683-project Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 94473332fd86422a9f1a1eed466f5a5a Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-DeleteServersTestJSON-1561437683-project Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.226890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'f0cb66da-ec40-427a-ba23-a4588100f09b'} Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:32:23.227536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.230009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.231168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Returning 404 to user: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:32:23.231168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b032e48f-d998-4996-a9bf-b8239b29699f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 404 len: 111 microversion: 2.1 time: 0.035547 Aug 10 12:32:23.231168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 105/193] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:32:23 2022] DELETE /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:32:23.239772 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:23.240450 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] [instance: f0cb66da-ec40-427a-ba23-a4588100f09b] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:23.254625 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:23.256708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:23.257157 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:23.258002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:23.259418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:23.260057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:23.261675 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:23.262117 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:23.274226 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:23.274911 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:23.277033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:23.279436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:23.279952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:23.280488 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:23.297077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] HTTP exception thrown: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Request method failure captured: Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b HTTP/1.1 Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86URWY6yCw56GCnAR4hKQMzqwqh9vJD0lu2KpRaTrOlJCtTIkEroV-QutfCGHEHOYBKGRu9SSOo9PBsfobzgGg3ZMxHh3tS8RgM3bA7MJCmIjAxZ7dVs8dApEx2SCzsnSMceTMPqwjeFHgQJ2fBIo6EA1Wm4tfF-pszIcL9lBioQbk8 Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 28eda660c33645f8a4428987084ab934 Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:32:23.303376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28eda660c33645f8a4428987084ab934"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_28eda660c33645f8a4428987084ab934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/28eda660c33645f8a4428987084ab934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/28eda660c33645f8a4428987084ab934"}]}] Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 28eda660c33645f8a4428987084ab934 Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-DeleteServersTestJSON-1561437683 Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-DeleteServersTestJSON-1561437683-project Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 94473332fd86422a9f1a1eed466f5a5a Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-DeleteServersTestJSON-1561437683-project Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.304633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'f0cb66da-ec40-427a-ba23-a4588100f09b'} Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:32:23.305312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. Aug 10 12:32:23.306358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:32:23.309039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] Returning 404 to user: Instance f0cb66da-ec40-427a-ba23-a4588100f09b could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:32:23.310551 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2146a5c4-8add-428c-9d4f-2e08f387e35f tempest-DeleteServersTestJSON-1561437683 tempest-DeleteServersTestJSON-1561437683-project] 10.222.0.65 "GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b" status: 404 len: 111 microversion: 2.1 time: 0.076734 Aug 10 12:32:23.311607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 89/194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:23 2022] GET /compute/v2.1/servers/f0cb66da-ec40-427a-ba23-a4588100f09b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:32:23.592261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:23.600548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-305b5a50-f302-428b-9215-cfc0ff8a7783 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.354908 Aug 10 12:32:23.601125 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 106/195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:23 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:24.621823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:24.622485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:24.630858 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:24.631355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:24.631799 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:24.632506 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:24.632962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:24.633414 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:24.860218 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:24.872001 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a0348d74-a291-4fb2-b216-7b3ff98fcd20 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.254412 Aug 10 12:32:24.873284 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 90/196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:24 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:25.895185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:25.895820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:25.902129 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:25.902616 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:25.903337 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:25.904325 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:25.904968 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:25.905932 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:26.056870 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:26.065514 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8ee63fe8-a87f-4a5e-a075-4fad455ea98d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.174119 Aug 10 12:32:26.066171 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 107/197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:25 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:27.087084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:27.087722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:27.094782 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:27.095260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:27.095691 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:27.096383 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:27.096836 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:27.097544 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:27.249737 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:27.258031 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f4634908-7407-46ac-bfd4-f83cc9306f6d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.174747 Aug 10 12:32:27.258605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 91/198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:27 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:28.277972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:28.279113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:28.285025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:28.285533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:28.285970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:28.286652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:28.287100 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:28.287521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:28.420591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:28.427885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a72a50e8-c718-4e2f-989b-c8ac1fe20162 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.153623 Aug 10 12:32:28.428459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 108/199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:28 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:29.448449 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:29.449166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:29.456588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:29.457078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:29.457721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:29.458423 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:29.458880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:29.459481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:29.605802 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:29.614222 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-470475e5-7fb6-42c7-afa0-b87f6fc432b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.169698 Aug 10 12:32:29.615012 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 92/200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:29 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:30.636874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:30.638126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:30.645593 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:30.646360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:30.647035 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:30.647949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:30.648597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:30.649212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:30.944476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:30.963034 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7dfae6d0-4bf2-4769-81e5-185e97f5c4af tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.330883 Aug 10 12:32:30.963697 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 109/201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:30 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:31.984603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:31.985215 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:31.994129 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:31.994636 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:31.995073 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:31.995945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:31.998045 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:31.998765 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:32.238769 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:32.256568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-700ce269-b898-456b-97b7-83a7e95a5617 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.271682 Aug 10 12:32:32.257209 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 93/202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:31 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:33.130769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7f99a845-3149-4dcc-b4fe-8ff65f9b4425 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'create', calling method: .version_select at 0x7fcb98105040>, body: {"keypair": {"name": "tempest-keypair-595886576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImZbO+IILlRHEec+qqdyYK5O9mQh7jS6tmFz0XpRNe79PrnBYEx2PqwhynKmbzVTQIhSK46+pYNuViN2ddU18qUWmjxOwdYICEo5c5gUkCQey0UpXOYM2yDkXK8U/g8RA=="}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:33.150613 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=47 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:33.168111 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-7f99a845-3149-4dcc-b4fe-8ff65f9b4425 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Getting quotas for project 82c24c64f4c34921837eceb32e24a287. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:32:33.176882 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-7f99a845-3149-4dcc-b4fe-8ff65f9b4425 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Getting quotas for user e6842565de354b0c85b04940d57c7432 and project 82c24c64f4c34921837eceb32e24a287. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:32:33.208377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7f99a845-3149-4dcc-b4fe-8ff65f9b4425 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.220683 Aug 10 12:32:33.208986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 110/203] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:32:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:32:33.277764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:33.278413 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:33.286095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:33.286816 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:33.287472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:33.288383 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:33.289066 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:33.289837 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:33.439885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:33.458809 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0657b175-5c01-4fa9-9c2e-4ce706255e85 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.185709 Aug 10 12:32:33.459399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 94/204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:33 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:34.486868 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:34.486868 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:34.489950 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:34.490149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:34.490833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:34.491612 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:34.492132 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:34.492760 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:34.530363 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1118452522", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "236b8912-0b35-45fe-a06b-75541ed0e553"}], "security_groups": [{"name": "tempest-securitygroup--1076209328"}], "key_name": "tempest-keypair-595886576", "user_data": "}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:34.634746 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:34.642556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-83d0d123-ba08-4377-aa31-207a08eeb8fa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.166665 Aug 10 12:32:34.643112 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 111/205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:34 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:35.666025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:35.667662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:35.676000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:35.676919 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:35.677605 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:35.678585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:35.679378 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:35.693253 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:35.862701 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:35.870376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-aed9510f-2919-4054-a331-a19c741745d8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.210554 Aug 10 12:32:35.871027 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 112/206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:35 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:36.890672 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:36.891273 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:36.897190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:36.897706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:36.898147 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:36.898842 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:36.899303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:36.899729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:37.032921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:37.041733 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a7db663e-1559-4cf3-911e-d45517559762 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.154791 Aug 10 12:32:37.042661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 113/207] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:36 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:38.063751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:38.064363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:38.070231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:38.070713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:38.071143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:38.071825 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:38.072280 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:38.072696 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:38.199573 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:38.207369 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9edfdcfd-899f-466d-83c2-5c860c635053 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.148091 Aug 10 12:32:38.208011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 114/208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:38 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:39.228167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:39.228789 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:39.234760 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:39.235246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:39.235703 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:39.236382 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:39.236843 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:39.237393 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:39.256373 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:39.371321 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:39.379258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4b16e6b1-757e-4b40-83e8-764c7d7032cf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.154928 Aug 10 12:32:39.379819 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 115/209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:39 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:40.400325 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:40.400928 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:40.407320 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:40.407803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:40.408231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:40.408913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:40.409394 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:40.409813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:40.534349 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:40.541741 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8da9567d-3738-4cd5-a13c-4c8939006fc7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.145385 Aug 10 12:32:40.542300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 116/210] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:40 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:41.562590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:41.563181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:41.569324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:41.569813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:41.570247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:41.570944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:41.571416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:41.571821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:41.702797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:41.710108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-820e9691-339e-4d44-b951-1180b64eedf2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.151407 Aug 10 12:32:41.710659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 117/211] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:41 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:42.732114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:42.732798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:42.739672 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:42.740160 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:42.740593 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:42.741331 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:42.741766 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:42.742182 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:42.879222 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:42.886678 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b4a80062-ece8-4138-85ce-26b370e78753 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.158513 Aug 10 12:32:42.887241 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 118/212] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:42 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:43.445558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=58 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:43.907241 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:43.907807 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:43.909661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=4 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:43.915149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:43.915630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:43.916075 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:43.916776 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:43.917223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:43.917668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:44.045886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:44.053426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d63fc72b-4cdc-41ce-b4b3-c51a41bb231f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.150028 Aug 10 12:32:44.054002 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 119/213] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:43 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:44.543527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:45.074547 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:45.075094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:45.081457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:45.081946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:45.082374 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:45.083053 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:45.083506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:45.083925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:45.220015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:45.227612 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5bd58785-058d-4a8f-94c1-3d10e590bffe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.156976 Aug 10 12:32:45.228175 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 120/214] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:45 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:46.247943 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:46.248596 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:46.254428 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:46.254945 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:46.255385 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:46.256519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:46.256519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:46.257094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:46.388946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:46.396968 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-eb58b83b-741d-4bcf-9361-d36ffe467267 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.152857 Aug 10 12:32:46.397633 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 121/215] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:46 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:47.419226 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:47.419851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:47.427214 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:47.427711 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:47.428168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:47.428873 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:47.429363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:47.429796 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:47.571219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:47.585870 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f5401751-31e5-44fc-ae9c-79000a3a36e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.170691 Aug 10 12:32:47.586626 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 122/216] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:47 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:48.155565 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] validate_networks() for [('236b8912-0b35-45fe-a06b-75541ed0e553', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:32:48.587557 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:32:48.587978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:32:48.588456 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:32:48.588869 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:32:48.589326 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:32:48.598321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:48.598805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:48.599321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:48.599954 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:48.600418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:48.600847 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:48.607168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:48.607905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:48.614228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:48.614706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:48.615138 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:48.615822 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:48.616269 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:48.616691 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:48.618737 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Getting quotas for project 82c24c64f4c34921837eceb32e24a287. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:32:48.622709 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Getting quotas for user e6842565de354b0c85b04940d57c7432 and project 82c24c64f4c34921837eceb32e24a287. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:32:48.634506 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:32:48.636824 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:32:48.683157 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9447ac61-ae91-4618-977a-d22fcf4851cf tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 14.157537 Aug 10 12:32:48.683940 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 95/217] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:32:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 14159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 12:32:48.695226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c4b63648-35bd-4501-862f-48982615c37f tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:48.695831 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c4b63648-35bd-4501-862f-48982615c37f tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:48.755924 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c4b63648-35bd-4501-862f-48982615c37f tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:48.766774 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c4b63648-35bd-4501-862f-48982615c37f tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1237 microversion: 2.1 time: 0.075002 Aug 10 12:32:48.773312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 96/218] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:48 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:48.778350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:48.789024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5ab389c2-7af8-4e4a-8736-9edf6ca6f6ed tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.185536 Aug 10 12:32:48.789724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 123/219] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:48 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:49.787594 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:49.788235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:49.794695 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:49.795178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:49.795614 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:49.796299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:49.796757 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:49.797176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:49.810611 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:49.811725 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:49.817697 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:49.818190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:49.818629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:49.819323 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:49.819776 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:49.820199 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:49.862330 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:49.869909 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f064744d-e526-4cad-bc30-8c33df5a4076 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1289 microversion: 2.1 time: 0.086191 Aug 10 12:32:49.870486 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 97/220] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:49 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:49.957855 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:49.965223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-85f7a05e-afdc-4734-bfae-036c6c810d3a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.158409 Aug 10 12:32:49.965820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 124/221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:49 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:50.891775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:50.892302 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:50.898612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:50.899120 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:50.899728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:50.900519 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:50.900976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:50.901422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:50.966071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:50.979539 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-56dbc148-ed66-47df-bf5b-56b57ec6e411 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1295 microversion: 2.1 time: 0.091866 Aug 10 12:32:50.980500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 98/222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:50 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:50.988145 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:50.989541 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:50.995977 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:50.996457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:50.996895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:50.997609 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:50.998064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:50.998486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:51.126760 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:51.134254 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-71e8d69b-4a7f-4b7d-a15c-208edb8f0ef0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1521 microversion: 2.1 time: 0.151926 Aug 10 12:32:51.134751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 125/223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:50 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:52.001385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:52.002075 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:52.009576 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:52.010159 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:52.010693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:52.011611 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:52.012074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:52.012506 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:52.156700 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:52.158100 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:52.166495 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:52.166774 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:52.167427 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:52.168011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:52.169068 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:52.169592 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:52.171263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:52.175405 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0c77739b-a32c-4521-bd55-3a46ec1cd0b9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.177907 Aug 10 12:32:52.176087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 99/224] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:51 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:52.407812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:52.415341 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-37d49d21-cbf1-46a0-9b88-4341b2113cd8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1501 microversion: 2.1 time: 0.263148 Aug 10 12:32:52.415900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 126/225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:52 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1501 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:32:52.435817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:52.436655 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:52.445169 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:52.446043 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:52.446834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:52.447618 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:52.448149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:52.448645 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:52.590243 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:52.598138 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f62a2868-9ed3-437f-91f3-656c0d603ffd tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1514 microversion: 2.1 time: 0.166213 Aug 10 12:32:52.598890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 100/226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:52 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:52.891803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-b7435b02-da0f-4e7f-a212-566d2e43e2ff req-5f038543-b088-4743-9e9c-80451683f376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67832a65-635c-45ac-830c-7ae989a1fea6", "tag": "6d220b97-f3b8-4e54-a5e7-2f570e5e93a2"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:52.909327 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-b7435b02-da0f-4e7f-a212-566d2e43e2ff req-5f038543-b088-4743-9e9c-80451683f376 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:52.910153 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-b7435b02-da0f-4e7f-a212-566d2e43e2ff req-5f038543-b088-4743-9e9c-80451683f376 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:52.910734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-b7435b02-da0f-4e7f-a212-566d2e43e2ff req-5f038543-b088-4743-9e9c-80451683f376 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:52.923472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-b7435b02-da0f-4e7f-a212-566d2e43e2ff req-5f038543-b088-4743-9e9c-80451683f376 service nova] Creating event network-changed:6d220b97-f3b8-4e54-a5e7-2f570e5e93a2 for instance 67832a65-635c-45ac-830c-7ae989a1fea6 on hv-cinder-85226 Aug 10 12:32:52.929430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-b7435b02-da0f-4e7f-a212-566d2e43e2ff req-5f038543-b088-4743-9e9c-80451683f376 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045647 Aug 10 12:32:52.930516 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 127/227] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:32:53.196117 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:53.196734 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:53.203674 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:53.204168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:53.204595 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:53.205320 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:53.205785 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:53.206212 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:53.338653 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:53.346481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e09b21df-fac4-430f-90b1-85c851b569f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.154389 Aug 10 12:32:53.347293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 101/228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:53 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:54.037580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:32:54.039887 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:54.045958 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:54.046444 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:54.046880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:54.047568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:54.048022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:54.048447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:54.070679 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lazy-loading 'flavor' on Instance uuid d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:32:54.145745 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3efa7dd0-c5ed-4e26-b96f-b40111feec1e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671/action" status: 200 len: 32 microversion: 2.1 time: 0.112666 Aug 10 12:32:54.146754 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 128/229] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:32:54 2022] POST /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:32:54.156604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:54.157309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:54.163332 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:54.163738 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:54.164168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:54.164856 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:54.165625 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:54.166046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:54.306433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:54.314261 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cd1a8218-0131-4ab5-bbb6-510760e8990c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.161953 Aug 10 12:32:54.314914 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 102/230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:54 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:54.368472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:54.369203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:54.375265 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:54.375744 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:54.376172 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:54.376858 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:54.377322 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:54.377746 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:54.577503 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:54.587365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-92925421-eb9b-416c-87f2-778e2cdd7902 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.223031 Aug 10 12:32:54.587939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 129/231] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:54 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:55.334675 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:55.335563 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:55.342567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:55.343102 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:55.343531 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:55.344222 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:55.344672 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:55.345091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:55.473851 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:55.481489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d66de684-18ac-4f65-ba39-d035d29a3563 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.150879 Aug 10 12:32:55.482045 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 103/232] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:55 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:55.614196 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:55.615157 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:55.621355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:55.621859 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:55.622289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:55.622981 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:55.623432 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:55.624389 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:55.998322 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:56.002404 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:56.007044 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4b60eb5e-e98d-43ac-bd40-412b17137243 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.401527 Aug 10 12:32:56.007597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 130/233] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:55 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:56.502713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:56.503325 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:56.509886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:56.510314 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:56.510985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:56.511680 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:56.512140 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:56.512563 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:56.647279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:56.654689 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-91559c56-08c1-49d8-a6d0-4bdb6dbceee5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.156021 Aug 10 12:32:56.655813 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 104/234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:56 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:57.028563 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:57.029198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:57.036547 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:57.037031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:57.037502 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:57.038190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:57.038644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:57.039069 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:57.164245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:57.171539 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9366f75f-87d7-4b52-ba89-c67479ae5a03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.146813 Aug 10 12:32:57.172098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 131/235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:57 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:57.676461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:57.677060 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:57.683398 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:57.683877 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:57.684309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:57.684988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:57.685476 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:57.685898 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:57.816056 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:57.824198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-56fbabd1-b7d6-408f-b333-76fa298f351f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.151463 Aug 10 12:32:57.824710 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 105/236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:57 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:58.192533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:58.193170 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:58.199050 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:58.199535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:58.199969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:58.200659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:58.201115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:58.201563 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:58.337571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:58.345288 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7272d038-ac17-4578-aff4-5573b9b77c93 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.156578 Aug 10 12:32:58.345863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 132/237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:58 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:58.846152 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:58.846788 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:58.848886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:58.850730 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=8 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:32:58.857409 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:58.857898 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:58.858942 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:58.859763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:58.860221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:58.860649 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:58.995961 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:59.003533 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8cd84077-a05f-4c3d-9309-1669f4664cfe tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.162031 Aug 10 12:32:59.004111 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 106/238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:58 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:32:59.366802 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:59.367416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:32:59.373307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:59.374300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:59.374738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:59.375430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:59.375886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:59.376313 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:59.501463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:32:59.508791 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b2fcbd9c-699d-4c06-b17f-bff7a2f0da45 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.145888 Aug 10 12:32:59.509383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 133/239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:32:59 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:00.025343 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:00.025886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:00.032714 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:00.033200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:00.033658 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:00.034343 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:00.034801 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:00.035227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:00.162250 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:00.169623 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-95290739-5d82-4805-8ec9-32176f8d2863 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.148110 Aug 10 12:33:00.170182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 107/240] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:00 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:00.355116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-d370dd12-610b-4e24-89be-a8c86f88f1d7 req-8c0b216a-cdcf-404a-834f-98509d95096e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67832a65-635c-45ac-830c-7ae989a1fea6", "name": "network-vif-plugged", "status": "completed", "tag": "6d220b97-f3b8-4e54-a5e7-2f570e5e93a2"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:00.366792 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d370dd12-610b-4e24-89be-a8c86f88f1d7 req-8c0b216a-cdcf-404a-834f-98509d95096e service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:00.367263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d370dd12-610b-4e24-89be-a8c86f88f1d7 req-8c0b216a-cdcf-404a-834f-98509d95096e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:00.367782 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d370dd12-610b-4e24-89be-a8c86f88f1d7 req-8c0b216a-cdcf-404a-834f-98509d95096e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:00.379160 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-d370dd12-610b-4e24-89be-a8c86f88f1d7 req-8c0b216a-cdcf-404a-834f-98509d95096e service nova] Creating event network-vif-plugged:6d220b97-f3b8-4e54-a5e7-2f570e5e93a2 for instance 67832a65-635c-45ac-830c-7ae989a1fea6 on hv-cinder-85226 Aug 10 12:33:00.384397 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-d370dd12-610b-4e24-89be-a8c86f88f1d7 req-8c0b216a-cdcf-404a-834f-98509d95096e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033835 Aug 10 12:33:00.384984 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 134/241] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:00.529512 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:00.530786 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:00.536631 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:00.537127 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:00.537584 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:00.538278 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:00.538730 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:00.539152 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:00.670719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:00.679054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2b2e6cca-b34d-40a3-8f89-85ee37c923a4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.153464 Aug 10 12:33:00.679630 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 108/242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:00 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:01.191422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:01.192041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:01.198131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:01.198616 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:01.199048 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:01.199780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:01.200214 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:01.200655 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:01.331928 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:01.339371 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-33d16d8b-3177-495b-a715-e5a87b750473 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.152125 Aug 10 12:33:01.339937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 135/243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:01 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:01.699164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:01.699801 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:01.706120 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:01.706606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:01.707041 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:01.707726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:01.708178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:01.708599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:01.845984 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:01.855038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fe374871-1758-4cd3-81dc-8c09eb3cdafd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1363 microversion: 2.1 time: 0.159697 Aug 10 12:33:01.855544 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 109/244] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:01 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:02.361800 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:02.362446 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:02.368970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:02.369576 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:02.370096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:02.370856 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:02.371378 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:02.372000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:02.502840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:02.510313 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ee7e7da9-672d-403e-b84f-6a3939742e62 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.152413 Aug 10 12:33:02.510873 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 136/245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:02 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:02.877240 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:02.877803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:02.884293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:02.884773 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:02.885205 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:02.885941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:02.886401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:02.886820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:03.024284 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:03.038091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-303e01c9-5458-4838-9fb1-13586466695d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1549 microversion: 2.1 time: 0.164812 Aug 10 12:33:03.038883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 110/246] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:02 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:03.060532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:03.061247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:03.069413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:03.070122 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:03.070723 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:03.071716 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:03.072318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:03.072884 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:03.168631 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cfb6a6dc-e06a-4dec-b2ed-4df81489bb02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112047 Aug 10 12:33:03.169212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 137/247] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 10 12:33:03 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:03.532100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:03.532720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:03.538996 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:03.539488 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:03.539929 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:03.540631 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:03.541091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:03.541554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:03.966900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:03.975203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a35f1354-1358-4883-a174-ca10ca63f332 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.447051 Aug 10 12:33:03.975775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 111/248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:03 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:04.318950 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:04.319448 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:04.322491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:04.341186 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:04.341815 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:04.342304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:04.343567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:04.344021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:04.344447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:04.368967 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2bc84f8c-44ee-4184-907e-fd17f9b3cd7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/ips" status: 200 len: 150 microversion: 2.20 time: 0.053990 Aug 10 12:33:04.369572 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 138/249] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 10 12:33:04 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:33:04.472118 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-ce9f343c-cfd2-4043-8ef7-d92d8f8ef123 req-87f2edce-8327-4ca4-8065-bc6dbad7608a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67832a65-635c-45ac-830c-7ae989a1fea6", "tag": "6d220b97-f3b8-4e54-a5e7-2f570e5e93a2"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:04.476223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:04.476773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:04.481495 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ce9f343c-cfd2-4043-8ef7-d92d8f8ef123 req-87f2edce-8327-4ca4-8065-bc6dbad7608a service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:04.482300 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ce9f343c-cfd2-4043-8ef7-d92d8f8ef123 req-87f2edce-8327-4ca4-8065-bc6dbad7608a service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:04.483373 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ce9f343c-cfd2-4043-8ef7-d92d8f8ef123 req-87f2edce-8327-4ca4-8065-bc6dbad7608a service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:04.484846 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:04.485355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:04.485802 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:04.486505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:04.486968 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:04.487397 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:04.498233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-ce9f343c-cfd2-4043-8ef7-d92d8f8ef123 req-87f2edce-8327-4ca4-8065-bc6dbad7608a service nova] Creating event network-changed:6d220b97-f3b8-4e54-a5e7-2f570e5e93a2 for instance 67832a65-635c-45ac-830c-7ae989a1fea6 on hv-cinder-85226 Aug 10 12:33:04.513799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3b0424c3-4ddc-42d5-914e-10071bc3dc53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/ips" status: 200 len: 150 microversion: 2.1 time: 0.041504 Aug 10 12:33:04.514972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 139/250] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:33:04 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:04.517369 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-ce9f343c-cfd2-4043-8ef7-d92d8f8ef123 req-87f2edce-8327-4ca4-8065-bc6dbad7608a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049128 Aug 10 12:33:04.517988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 112/251] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:05.000043 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:05.001391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:05.016623 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:05.017738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:05.019443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:05.023424 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:05.024106 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:05.025221 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:05.312830 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:05.322802 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f1b64c4d-b881-49a7-9d90-68f9866bb481 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.329170 Aug 10 12:33:05.323440 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 140/252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:04 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:06.145940 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d651b075-70a7-48ee-8b35-acfbe2a0c10e"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:06.148407 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:06.156496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:06.158478 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:06.158931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:06.159648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:06.160107 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:06.160526 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:06.236295 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:06.343997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:06.344511 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:06.351628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:06.352160 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:06.352606 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:06.353374 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:06.353901 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:06.354687 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:06.496153 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:06.505547 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0542549e-0fdf-47a6-b3d4-f62f731bfa58 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.165483 Aug 10 12:33:06.506514 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 141/253] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:06 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:07.526556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:07.527199 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:07.533116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:07.533630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:07.534060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:07.534743 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:07.535193 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:07.535611 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:07.661757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:07.669018 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-20a1b725-44fa-4a19-9628-91a464ef419c tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.146272 Aug 10 12:33:07.669611 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 142/254] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:07 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:07.889456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:07.889986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:07.896150 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:07.896636 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:07.897069 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:07.897809 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:07.898291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:07.898739 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:07.920936 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lazy-loading 'flavor' on Instance uuid b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:33:08.092223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9915f7a3-d88b-4daa-8bce-9df45185e23f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/action" status: 202 len: 0 microversion: 2.20 time: 0.206419 Aug 10 12:33:08.092848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 143/255] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 10 12:33:07 2022] POST /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 12:33:08.102137 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:08.102835 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:08.109729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:08.110215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:08.110653 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:08.111350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:08.111807 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:08.112232 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:08.241881 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:08.250439 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:08.251968 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:08.253135 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ae5255d7-b6b6-4d0d-8a20-9fd44d023541 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.155921 Aug 10 12:33:08.253736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 144/256] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:08 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:08.689816 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:08.690429 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:08.696660 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:08.697145 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:08.697609 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:08.698301 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:08.698763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:08.699193 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:08.825326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:08.833426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-82ac7078-e04c-4803-ad1a-6a1cc5bcb6c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.147408 Aug 10 12:33:08.833993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 145/257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:08 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:09.254406 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a25d86c1-0648-46cc-97ea-7eef133fba7f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.114462 Aug 10 12:33:09.255123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 113/258] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:33:06 2022] POST /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments => generated 194 bytes in 3116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:09.276328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:09.276866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:09.284232 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:09.284717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:09.286403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:09.286403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:09.286403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:09.286739 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:09.453805 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:09.462963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:09.464509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:09.465753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-67f9d1fc-9a91-4784-bb00-589069b55ea8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.193662 Aug 10 12:33:09.466304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 146/259] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:09 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:09.856183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:09.856800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:09.863805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:09.864290 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:09.864722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:09.865442 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:09.865899 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:09.866366 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:09.999036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:10.006514 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0a2807a8-3551-4f99-81be-84f244cdebcb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.155120 Aug 10 12:33:10.007074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 114/260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:09 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:10.488316 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:10.489241 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:10.496271 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:10.496763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:10.497296 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:10.498080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:10.499300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:10.499812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:10.505388 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:10.648078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:10.656539 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:10.667997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:10.667997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-581bf219-a759-4cb6-ab33-56fcb071448b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.175385 Aug 10 12:33:10.667997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 147/261] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:10 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:11.027827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:11.028458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:11.034964 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:11.035443 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:11.035880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:11.036637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:11.037024 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:11.037487 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:11.173120 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:11.180572 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-019601bb-f49b-4c12-8867-9401317ae58f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.156636 Aug 10 12:33:11.181140 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 115/262] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:11 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:11.681890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:11.682578 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:11.690548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:11.696377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:11.696998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:11.697841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:11.698261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:11.698689 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:11.867851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:11.876641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:11.878184 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:11.879340 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-201c5998-fb51-4d8b-8418-1fbe220e1867 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.201462 Aug 10 12:33:11.879891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 148/263] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:11 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:12.204748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:12.205259 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:12.212054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:12.212613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:12.213194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:12.214060 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:12.214582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:12.215073 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:12.356281 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:12.364643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cf4e40da-01a1-4cbf-91e1-9f1f351c52e0 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.164540 Aug 10 12:33:12.365210 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 116/264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:12 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:12.907755 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:12.908184 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:12.914794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:12.915447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:12.915924 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:12.916766 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:12.917399 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:12.917907 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:13.059802 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:13.067783 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:13.069295 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:13.070448 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e3b21a2e-9d02-4307-8906-129852bf7e3e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.167774 Aug 10 12:33:13.071064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 149/265] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:12 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:13.386512 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:13.387113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:13.393928 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:13.394397 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:13.394834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:13.395512 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:13.395962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:13.396380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:13.527424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:13.535347 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-78a04b30-bdf2-4044-9255-e6489f2c9047 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.153149 Aug 10 12:33:13.536333 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 117/266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:13 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:14.093145 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:14.094425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:14.101141 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:14.101652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:14.102255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:14.103108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:14.103741 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:14.104321 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:14.288820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:14.296942 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:14.299063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:14.300431 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-718ef38b-ec64-4dba-bfa0-ba5ed338db04 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.211118 Aug 10 12:33:14.301433 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 150/267] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:14 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:14.556701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:14.557408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:14.559981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:14.566662 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:14.566974 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:14.567380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:14.568062 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:14.568519 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:14.568944 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:14.762659 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:14.770104 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8a915f23-6ebe-40a0-907e-149b5234e6d5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.217947 Aug 10 12:33:14.770670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 118/268] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:14 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:15.324326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:15.324986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:15.331784 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:15.332468 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:15.332928 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:15.333685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:15.334360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:15.334958 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:15.496781 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:15.506150 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:15.507838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:15.509303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8e245a46-323f-492e-beb2-eb93ea462e96 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.189260 Aug 10 12:33:15.510081 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 151/269] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:15 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:15.791548 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:15.792153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:15.799026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:15.799519 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:15.799955 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:15.800749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:15.801208 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:15.801653 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:15.996906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:16.004620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ab11c17f-0f48-4857-b856-f22dc35caf1f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.216974 Aug 10 12:33:16.018524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 119/270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:15 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:16.533940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:16.535174 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:16.547816 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:16.548306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:16.548740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:16.549472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:16.549925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:16.550343 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:16.734474 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:16.746166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:16.752080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:16.753551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f0f19144-f1bb-4204-a833-fa1f050cccbe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.225350 Aug 10 12:33:16.756142 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 152/271] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:16 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:16.878204 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-05735be2-8937-4a7a-82b5-4481bbb03e7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: .version_select at 0x7fcb980e9ee0>, body: {"keypair": {"name": "tempest-keypair-71050895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPwX7aEhaEd7pIY8RPzqb+stc14Df5xHf0JAYuGppYxLpgfss2/bpnYFJ7YcFcY/ErI098LcdH614BRr78V/Uw7oEQnABi7+DqSmzKfuMbjc6plSzSWNB4X95thZbKFsQ=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:16.900171 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-05735be2-8937-4a7a-82b5-4481bbb03e7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for project 0bbb137a895941b1876eebfc56c28425. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:33:16.906385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-05735be2-8937-4a7a-82b5-4481bbb03e7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for user 9b8e4aad09814f8299a334639e34d948 and project 0bbb137a895941b1876eebfc56c28425. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:33:16.981297 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-05735be2-8937-4a7a-82b5-4481bbb03e7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.108255 Aug 10 12:33:16.989334 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 120/272] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:33:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:17.025246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:17.026011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:17.032442 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:17.033046 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:17.033549 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:17.034284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:17.034946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:17.036116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:17.352225 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:17.366059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-98948e3b-7148-403d-b42b-52fc682f5f51 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.344829 Aug 10 12:33:17.367775 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 153/273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:17 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:17.780290 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:17.780913 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:17.788020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:17.788727 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:17.789363 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:17.790228 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:17.790836 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:17.791399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:18.388212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:18.389398 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:18.403055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:18.403859 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:18.405187 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:18.406333 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:18.406976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:18.407406 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:18.435530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:18.449600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:18.451481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:18.452834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-62fa4214-4f01-4e56-80ae-683e49a7c3fc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.677826 Aug 10 12:33:18.466030 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 121/274] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:17 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:18.641425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:18.653021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-609f2279-65fc-41a2-bacc-1f8ceb2f3a40 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.268632 Aug 10 12:33:18.668087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 154/275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:18 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:19.489551 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:19.490820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:19.511034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:19.519085 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:19.519800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:19.520770 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:19.521496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:19.522127 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:19.675318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:19.675933 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:19.689077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:19.689608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:19.690291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:19.691120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:19.691583 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:19.696363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:19.798676 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:19.808000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:19.810218 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:19.812213 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d51ebf7d-a74c-4385-9709-5074ca9e9a4f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.327130 Aug 10 12:33:19.818538 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 122/276] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:19 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:19.838965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1364873261", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69a0d312-b2de-4689-b0c5-62b84c9112b2"}], "security_groups": [{"name": "tempest-securitygroup--1544745054"}], "key_name": "tempest-keypair-71050895", "user_data": "}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:20.031674 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] validate_networks() for [('69a0d312-b2de-4689-b0c5-62b84c9112b2', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:33:20.049130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:20.058668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e47e2168-b385-4d4d-a03a-ad8e5b8cff18 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.388151 Aug 10 12:33:20.076099 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 155/277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:19 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:20.672518 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:33:20.674242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:33:20.674885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:33:20.675569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:33:20.676246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:33:20.688053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:20.688552 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:20.688993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:20.689783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:20.690248 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:20.691017 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:20.708457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for project 0bbb137a895941b1876eebfc56c28425. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:33:20.712630 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for user 9b8e4aad09814f8299a334639e34d948 and project 0bbb137a895941b1876eebfc56c28425. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:33:20.724762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:33:20.727811 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:33:20.780697 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1dc61efd-ff59-409a-a7b3-2824b0cbd41f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.960766 Aug 10 12:33:20.781961 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 123/278] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:33:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:33:20.792296 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-964cdfad-cb20-45e4-88b8-1b59d5c62259 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:20.792915 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-964cdfad-cb20-45e4-88b8-1b59d5c62259 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:20.839946 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:20.840624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:20.849701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:20.850466 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:20.851176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:20.852132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:20.852743 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:20.853357 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:20.901633 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-964cdfad-cb20-45e4-88b8-1b59d5c62259 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:20.912392 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-964cdfad-cb20-45e4-88b8-1b59d5c62259 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1240 microversion: 2.1 time: 0.123784 Aug 10 12:33:20.915732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 156/279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:20 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1240 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:21.084484 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:21.085249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:21.087107 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:21.096567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:21.098431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:21.098662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:21.099933 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:21.100881 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:21.101450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:21.101858 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:21.102795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a2c58911-8de6-4189-a383-35667efe5325 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.268584 Aug 10 12:33:21.103825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 124/280] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:20 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:21.104258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:21.390099 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:21.401749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-60e961d9-daa1-4d74-8506-80e028622c4b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.322610 Aug 10 12:33:21.402895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 157/281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:21 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:21.936392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:21.937823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:21.946330 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:21.947187 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:21.947695 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:21.948632 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:21.949136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:21.949610 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:22.019715 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:22.040709 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0f65e551-c992-41c5-8fa2-c03c6eb5ef8c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1236 microversion: 2.1 time: 0.109260 Aug 10 12:33:22.041316 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 125/282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:21 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1236 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:22.127267 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:22.127860 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:22.134952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:22.135644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:22.136277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:22.137130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:22.137773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:22.138469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:22.271713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:22.280254 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:22.281928 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:22.283303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c03f78ff-7756-4293-a390-1b26ec31450d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.160572 Aug 10 12:33:22.283921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 158/283] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:22 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:22.428128 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:22.428778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:22.434941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:22.435535 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:22.436035 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:22.436803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:22.437262 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:22.437902 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:22.582486 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:22.590711 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f745779d-d276-4f40-81ed-2192d11224a4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.166787 Aug 10 12:33:22.592931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 126/284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:22 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:23.064790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:23.065829 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:23.077330 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:23.078213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:23.079137 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:23.080091 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:23.080754 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:23.082020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:23.167062 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:23.178096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-12a8576a-632b-4787-bfa8-76609a5d563c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1292 microversion: 2.1 time: 0.118806 Aug 10 12:33:23.180575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 159/285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:23 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1292 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:23.306326 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:23.307150 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:23.316583 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:23.317142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:23.317612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:23.318328 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:23.318792 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:23.319222 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:23.597545 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:23.605956 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:23.608764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:23.610916 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-69d6df58-ae90-4782-a3dc-d4928411a416 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.308727 Aug 10 12:33:23.612084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 127/286] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:23 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:23.613010 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:23.613658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:23.619700 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:23.620622 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:23.621321 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:23.622244 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:23.622912 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:23.624104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:23.815164 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:23.827591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-93f3e641-a872-4661-bc22-b21246ed70c6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.218134 Aug 10 12:33:23.828952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 160/287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:23 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:24.202512 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:24.203456 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:24.211977 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:24.212888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:24.214247 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:24.215914 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:24.217329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:24.217982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:24.362162 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:24.383528 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bf88835d-1c19-4e96-a09c-91174c3f25c6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1310 microversion: 2.1 time: 0.185262 Aug 10 12:33:24.387500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 128/288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:24 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1310 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:24.638019 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:24.638791 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:24.645105 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:24.645913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:24.646552 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:24.647553 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:24.648183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:24.648769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:24.849222 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:24.849871 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:24.860650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:24.865624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:24.866215 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:24.867042 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:24.867654 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:24.868085 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:25.426057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:25.440315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:25.447467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:25.448887 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-fbf31c15-c0bf-4868-b253-42a951ff33c5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.816788 Aug 10 12:33:25.453088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 161/289] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:24 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:25.464585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:25.469220 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:25.486218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:25.487036 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:25.489621 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:25.491176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:25.492428 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:25.494129 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:25.584282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:25.609560 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-87586637-1451-419f-8e3c-a570f077ffc9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1500 microversion: 2.1 time: 0.748873 Aug 10 12:33:25.609560 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 129/290] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:24 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1500 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:25.610208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:25.616044 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-14ff7311-b4d6-4a48-9903-2853ddb22707 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1298 microversion: 2.1 time: 0.159366 Aug 10 12:33:25.619766 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 162/291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:25 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:25.623140 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31ceda27-965b-40f2-8142-ff386197939f"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:25.625653 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:25.643354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:25.644896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:25.648168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:25.650124 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:25.651906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:25.653556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:25.713042 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] HTTP exception thrown: Cannot 'attach_volume' instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 while it is in vm_state rescued Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Request method failure captured: Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: POST /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671/os-volume_attachments HTTP/1.1 Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 74 Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UVCZy5cePM0_ipeKQGog--zdcGvp9RYAIh0ETNO7C_3X7o1pwdTynr0ywJx0KC7nZ4LUrhMqxiuprvTLwbCri2KCNWuuLilVY1_i-Mk6T1KxaJyBHdOkYA6xYKYWVs9Sp5sN4E6C3M9XINhC3x5-uhV528eibATDOc31y-O2lsFbU Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:33:25.727678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2301f937213e47c29686be4e8601ac32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2301f937213e47c29686be4e8601ac32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}] Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 2aa6d6d56f9f4618ae3883c9beb2e77b Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {"volumeAttachment": {"volumeId": "31ceda27-965b-40f2-8142-ff386197939f"}} Aug 10 12:33:25.729183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Cannot 'attach_volume' instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 while it is in vm_state rescued Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'server_id': 'd9d0ad15-5ec9-405f-ad6d-2d0b9a2db671', 'body': {'volumeAttachment': {'volumeId': '31ceda27-965b-40f2-8142-ff386197939f'}}} Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:33:25.730275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 while it is in vm_state rescued Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:33:25.731615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:33:25.733399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:33:25.733399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:33:25.733399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 while it is in vm_state rescued Aug 10 12:33:25.733399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:33:25.734408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Returning 409 to user: Cannot 'attach_volume' instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 while it is in vm_state rescued {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:33:25.737218 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ef730d62-a33c-4964-9399-781a756f84e5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.118301 Aug 10 12:33:25.744746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 130/292] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:33:25 2022] POST /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671/os-volume_attachments => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 12:33:25.751955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:25.752493 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:25.766229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:25.767624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:25.768298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:25.769213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:25.770036 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:25.770624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:26.113350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:26.126609 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3711f8d3-e6bd-4bcd-9989-e97005c7192f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671/action" status: 202 len: 0 microversion: 2.1 time: 0.380238 Aug 10 12:33:26.130427 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 163/293] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:33:25 2022] POST /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:33:26.136331 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:26.137865 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:26.150345 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:26.151221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:26.152420 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:26.155761 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:26.158937 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:26.159517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:26.174074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:26.477733 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:26.478599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:26.506279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:26.510919 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:26.516036 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:26.516840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:26.518529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:26.518674 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:26.519402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:26.528965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-aa0cccd6-3ed1-439a-876c-213af55e9abb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1508 microversion: 2.1 time: 0.396465 Aug 10 12:33:26.541407 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 131/294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:26 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1508 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:26.640828 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:26.641485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:26.652030 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:26.653895 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:26.658163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:26.660020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:26.660536 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:26.662271 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:27.031120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:27.044428 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:27.047923 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:27.052568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8a96a2c9-0084-427d-8457-37288fa98b72 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1742 microversion: 2.20 time: 0.580488 Aug 10 12:33:27.062107 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 164/295] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:26 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1742 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:27.362847 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:27.384455 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a3bff75d-de61-4e49-8048-e35968250f53 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1366 microversion: 2.1 time: 0.747880 Aug 10 12:33:27.385672 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 132/296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:26 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1366 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:27.554896 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:27.555757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:27.562446 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:27.563143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:27.563751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:27.564740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:27.565381 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:27.565973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:27.980679 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:27.990951 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a95fa02e-5828-478b-bf74-0fd5064cb048 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1508 microversion: 2.1 time: 0.439921 Aug 10 12:33:27.994094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 165/297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:27 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:28.077979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:28.078699 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:28.089739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:28.090463 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:28.092825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:28.100677 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:28.101722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:28.102482 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:28.198203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-4dfb0aa3-6a46-4bc7-bfa9-e07e91d40a7c req-ff5564a1-3d77-4992-861e-407459f1b758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6264d236-8e5e-4e84-818f-10b9a8c54235", "tag": "5082193a-c1c4-4193-a2e4-4f3ddef91ba7"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:28.220099 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-4dfb0aa3-6a46-4bc7-bfa9-e07e91d40a7c req-ff5564a1-3d77-4992-861e-407459f1b758 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:28.220855 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-4dfb0aa3-6a46-4bc7-bfa9-e07e91d40a7c req-ff5564a1-3d77-4992-861e-407459f1b758 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:28.221472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-4dfb0aa3-6a46-4bc7-bfa9-e07e91d40a7c req-ff5564a1-3d77-4992-861e-407459f1b758 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:28.260413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-4dfb0aa3-6a46-4bc7-bfa9-e07e91d40a7c req-ff5564a1-3d77-4992-861e-407459f1b758 service nova] Creating event network-changed:5082193a-c1c4-4193-a2e4-4f3ddef91ba7 for instance 6264d236-8e5e-4e84-818f-10b9a8c54235 on hv-cinder-85226 Aug 10 12:33:28.314753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-4dfb0aa3-6a46-4bc7-bfa9-e07e91d40a7c req-ff5564a1-3d77-4992-861e-407459f1b758 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117716 Aug 10 12:33:28.314931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 166/298] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:28.408558 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:28.409603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:28.418879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:28.422997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:28.423580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:28.424819 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:28.426496 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:28.426968 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:28.475913 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:28.489884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:28.499267 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:28.530500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-72c0e69b-5e67-4eb5-91dd-a80b1efab946 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.456202 Aug 10 12:33:28.532641 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 133/299] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:28 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:28.629640 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:28.639180 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e4cba9d9-ce66-474d-ab76-b5ba73867d2e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1366 microversion: 2.1 time: 0.235918 Aug 10 12:33:28.644532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 167/300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:28 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:29.017957 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:29.019026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:29.038322 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:29.038900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:29.039854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:29.041342 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:29.042163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:29.042945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:29.271641 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:29.279885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6d14e56a-bdfd-4f1b-9316-eedf43a48ab9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1508 microversion: 2.1 time: 0.267182 Aug 10 12:33:29.305780 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 134/301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:29 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:29.380143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-590d0433-8e76-488d-9163-7ee699b30337 req-ed62f9d2-7e6b-44a9-bf38-a2911e1e05f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2", "name": "network-vif-plugged", "status": "completed", "tag": "dd060781-b144-4d67-99d5-c6d10616e60b"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:29.396891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-590d0433-8e76-488d-9163-7ee699b30337 req-ed62f9d2-7e6b-44a9-bf38-a2911e1e05f1 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:29.397964 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-590d0433-8e76-488d-9163-7ee699b30337 req-ed62f9d2-7e6b-44a9-bf38-a2911e1e05f1 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:29.398821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-590d0433-8e76-488d-9163-7ee699b30337 req-ed62f9d2-7e6b-44a9-bf38-a2911e1e05f1 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:29.420450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-590d0433-8e76-488d-9163-7ee699b30337 req-ed62f9d2-7e6b-44a9-bf38-a2911e1e05f1 service nova] Creating event network-vif-plugged:dd060781-b144-4d67-99d5-c6d10616e60b for instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 on hv-cinder-85226 Aug 10 12:33:29.435977 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-590d0433-8e76-488d-9163-7ee699b30337 req-ed62f9d2-7e6b-44a9-bf38-a2911e1e05f1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063705 Aug 10 12:33:29.437459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 168/302] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:29.555714 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:29.557022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:29.568324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:29.568998 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:29.576739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:29.579111 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:29.579830 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:29.580419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:29.668916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:29.670510 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:29.679729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:29.685287 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:29.687108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:29.688028 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:29.689387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:29.691683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:29.873901 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:29.887021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:29.889061 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:29.890573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0a88ca83-1e0d-4fb2-adf4-d6e9d3236b50 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.339740 Aug 10 12:33:29.910410 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 135/303] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:29 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:30.014537 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:30.030303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6b786f5f-9994-46c4-a7f5-f8c450338b16 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1366 microversion: 2.1 time: 0.368614 Aug 10 12:33:30.052491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 169/304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:29 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:30.323452 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:30.325199 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:30.335497 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:30.349054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:30.349615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:30.350374 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:30.351030 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:30.352049 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:30.675718 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:30.698288 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:30.701686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2b7dab84-f857-4205-bc9b-73ede51622b5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1508 microversion: 2.1 time: 0.385247 Aug 10 12:33:30.716246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 136/305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:30 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:30.927943 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:30.929363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:30.931794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:30.949376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:30.949900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:30.950350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:30.951176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:30.951654 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:30.952063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:31.058729 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:31.062309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:31.075329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=10 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:31.081405 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:31.081941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:31.083151 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:31.084392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:31.086132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:31.089399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:31.245639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:31.256281 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:31.257831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:31.266204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d3b61679-d94a-4d29-8d88-6f1274a557a8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.351905 Aug 10 12:33:31.277732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 170/306] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:30 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:31.425306 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:31.436029 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c52ec7dd-1bf6-4162-b24a-5d778aaa78a6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1366 microversion: 2.1 time: 0.384033 Aug 10 12:33:31.437433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 137/307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:31 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:31.724540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:31.725877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:31.743153 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:31.743809 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:31.744355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:31.745179 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:31.745773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:31.746307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:31.955131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:31.969992 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b2bbcd40-8725-4756-b4c2-8113d78befc1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1514 microversion: 2.1 time: 0.250034 Aug 10 12:33:31.973549 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 171/308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:31 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:32.297105 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:32.299850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:32.324210 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:32.325249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:32.325967 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:32.332988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:32.334145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:32.334885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:32.462651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:32.468092 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:32.478716 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:32.481885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:32.482617 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:32.498673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:32.502717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:32.524207 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:32.800327 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:32.810117 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:32.816703 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:32.818149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-885995f7-4213-410d-8a60-47dfa31b2ba0 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.525924 Aug 10 12:33:32.821234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 138/309] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:32 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:33.224646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:33.330183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-65705e1a-05b0-439a-9db3-ee567789b7a7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1366 microversion: 2.1 time: 0.872170 Aug 10 12:33:33.348962 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 172/310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:32 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1366 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:33.796873 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d0f3d0b7-07d4-44e5-84e9-36ac90c954d9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'create', calling method: .version_select at 0x7fcb982a3f70>, body: {"keypair": {"name": "tempest-keypair-376343480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuVhiG5nEvRTSf0jWkgoIfQGb+03VnkqjDfDU9tkhnjC9QUV6ldZ1KVX4Z7/y1GtM7b3OvW+TpODZn4r5wQk7zVKZEDD/7nAAM2SyxtsKpwcXZAwZxVSLgvHZSwla6B6Q=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:33.823440 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-d0f3d0b7-07d4-44e5-84e9-36ac90c954d9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Getting quotas for project 2301f937213e47c29686be4e8601ac32. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:33:33.847781 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-d0f3d0b7-07d4-44e5-84e9-36ac90c954d9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Getting quotas for user 2aa6d6d56f9f4618ae3883c9beb2e77b and project 2301f937213e47c29686be4e8601ac32. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:33:33.849340 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:33.850804 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:33.857794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:33.858550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:33.859185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:33.860079 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:33.860709 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:33.861311 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:33.898688 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d0f3d0b7-07d4-44e5-84e9-36ac90c954d9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106412 Aug 10 12:33:33.899535 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 139/311] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:33:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:34.168464 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:34.186483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:34.188263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:34.197080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9b2747bd-7cd0-4d67-ba56-2e80d12f1586 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.345200 Aug 10 12:33:34.197747 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 173/312] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:33 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:34.360708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:34.363533 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:34.382855 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:34.384893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:34.385647 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:34.388374 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:34.389698 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:34.390472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:34.666248 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:34.677066 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f1b293b9-4c7c-495b-a30c-9dcb35c13799 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1366 microversion: 2.1 time: 0.326378 Aug 10 12:33:34.679103 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 140/313] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:34 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:35.228360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:35.229117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:35.241520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=74 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:35.244597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:35.249815 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:35.251288 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:35.256431 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:35.257146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:35.258730 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:35.545183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:35.555648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:35.557490 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:35.561520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1c4373b7-df1b-41c1-bee2-7df14e0a7ea1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.334548 Aug 10 12:33:35.573944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 174/314] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:35 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:35.703599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:35.704147 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:35.715446 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:35.722573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:35.723031 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:35.727100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:35.734393 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:35.735610 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:35.970094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-b48810e7-4c09-45a8-9327-c942b4183d20 req-78290cc9-8e5e-426b-aa56-33b513ad8992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6264d236-8e5e-4e84-818f-10b9a8c54235", "name": "network-vif-plugged", "status": "completed", "tag": "5082193a-c1c4-4193-a2e4-4f3ddef91ba7"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:36.018641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-b48810e7-4c09-45a8-9327-c942b4183d20 req-78290cc9-8e5e-426b-aa56-33b513ad8992 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:36.023245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-b48810e7-4c09-45a8-9327-c942b4183d20 req-78290cc9-8e5e-426b-aa56-33b513ad8992 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:36.024359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-b48810e7-4c09-45a8-9327-c942b4183d20 req-78290cc9-8e5e-426b-aa56-33b513ad8992 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:36.055235 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-b48810e7-4c09-45a8-9327-c942b4183d20 req-78290cc9-8e5e-426b-aa56-33b513ad8992 service nova] Creating event network-vif-plugged:5082193a-c1c4-4193-a2e4-4f3ddef91ba7 for instance 6264d236-8e5e-4e84-818f-10b9a8c54235 on hv-cinder-85226 Aug 10 12:33:36.070598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-b48810e7-4c09-45a8-9327-c942b4183d20 req-78290cc9-8e5e-426b-aa56-33b513ad8992 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104430 Aug 10 12:33:36.082085 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 175/315] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:33:36.391440 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:36.406396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a7a7ce87-7952-4ffd-b3ab-3cce1243c47f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1366 microversion: 2.1 time: 0.706590 Aug 10 12:33:36.417750 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 141/316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:35 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1366 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:36.604414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:36.606972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:36.630325 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:36.631442 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:36.632628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:36.634136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:36.639268 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:36.641824 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:36.965045 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:36.986093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:36.988271 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:36.989775 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6a83729f-22df-4e89-9095-5d335f03e7be tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.406765 Aug 10 12:33:36.999328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 176/317] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:36 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:37.431462 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:37.433419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:37.442258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:37.445884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:37.446996 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:37.448740 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:37.455086 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:37.462115 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:37.472309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1961729529", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61402a18-53ba-4745-a9e1-e8ac1dfc87fb"}], "security_groups": [{"name": "tempest-securitygroup--360407006"}], "key_name": "tempest-keypair-376343480", "user_data": "}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:37.690992 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:37.726391 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b3372f3a-b3f2-4dae-94cb-6aa9c03f3e61 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1366 microversion: 2.1 time: 0.298804 Aug 10 12:33:37.740240 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 142/318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:37 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:38.022164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:38.022969 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:38.049126 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:38.050055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:38.050730 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:38.074497 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:38.077421 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:38.078307 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:38.293485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:38.306805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:38.308739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:38.310818 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e7ec04c0-d25f-492e-97ae-8b5294e79378 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.292658 Aug 10 12:33:38.312904 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 143/319] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:38 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:38.748465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:38.750084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:38.757834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:38.758601 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:38.759769 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:38.765497 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:38.766253 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:38.767107 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:38.981855 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:38.989443 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fec8a1a3-2476-4b56-aee5-1fb93034ee7d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1556 microversion: 2.1 time: 0.244956 Aug 10 12:33:38.990015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 144/320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:38 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:39.016888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:39.017667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:39.023897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:39.024614 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:39.025218 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:39.032099 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:39.032888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:39.033585 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:39.139819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-43b91ad8-0e19-4188-a388-ff52814a5484 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129092 Aug 10 12:33:39.146981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 145/321] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 10 12:33:39 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:39.336055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:39.336990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:39.360592 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:39.361090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:39.361553 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:39.362268 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:39.362719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:39.363139 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:39.578178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:39.592044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:39.594038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:39.596058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-36afb209-7738-4c8d-b2c0-2cf27165467f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.263464 Aug 10 12:33:39.614837 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 146/322] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:39 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:40.619035 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:40.620459 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:40.630341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:40.632510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:40.633794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:40.637814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:40.638717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:40.639389 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:40.883616 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:40.893963 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:40.896055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:40.897606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f49eaf5d-8396-4e82-8993-ca32b0655889 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.282425 Aug 10 12:33:40.911380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 147/323] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:40 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:40.922368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-09027e7c-7e9d-4f49-9f5c-d3728c812e32 req-e5581478-2151-4748-8ce8-98144fd11c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6264d236-8e5e-4e84-818f-10b9a8c54235", "tag": "5082193a-c1c4-4193-a2e4-4f3ddef91ba7"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:40.932921 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-09027e7c-7e9d-4f49-9f5c-d3728c812e32 req-e5581478-2151-4748-8ce8-98144fd11c01 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:40.933814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-09027e7c-7e9d-4f49-9f5c-d3728c812e32 req-e5581478-2151-4748-8ce8-98144fd11c01 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:40.934575 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-09027e7c-7e9d-4f49-9f5c-d3728c812e32 req-e5581478-2151-4748-8ce8-98144fd11c01 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:40.951281 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-09027e7c-7e9d-4f49-9f5c-d3728c812e32 req-e5581478-2151-4748-8ce8-98144fd11c01 service nova] Creating event network-changed:5082193a-c1c4-4193-a2e4-4f3ddef91ba7 for instance 6264d236-8e5e-4e84-818f-10b9a8c54235 on hv-cinder-85226 Aug 10 12:33:40.967284 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-09027e7c-7e9d-4f49-9f5c-d3728c812e32 req-e5581478-2151-4748-8ce8-98144fd11c01 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054309 Aug 10 12:33:40.968596 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 148/324] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:41.936727 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:41.938228 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:41.952999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:41.953771 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:41.954348 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:41.957489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:41.958116 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:41.958717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:42.199824 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:42.206321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:42.211700 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:42.213542 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:42.215034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fa3af4af-cd3a-4204-970a-bcd18026e857 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.283842 Aug 10 12:33:42.216128 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 149/325] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:41 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:43.219486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] validate_networks() for [('61402a18-53ba-4745-a9e1-e8ac1dfc87fb', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:33:43.240565 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:43.242133 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:43.244726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:43.250624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:43.251123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:43.251564 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:43.252269 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:43.253040 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:43.253507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:43.383768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:43.392341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:43.393901 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:43.395073 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2e48aa58-f94f-4421-a29a-de0acabe6605 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1737 microversion: 2.20 time: 0.158803 Aug 10 12:33:43.395629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 150/326] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:43 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:43.400050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4d79a5f4-e5b0-4bad-98b0-259ba0d08703 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Action: 'create', calling method: .version_select at 0x7fcb983c7ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2127501302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL/xBmsYsFvQjMoFDlnuSK9IPO/ZwSc3+TfWWXH3TwfKkZj3hzt34HdH7Oun4z7iE4XmbtlLfRTwKguCTMZz4uZe+RoPddddzdpPTX0CxiJbQ1/0KnNL0PWorTqYSsyrQ=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:43.415569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-4d79a5f4-e5b0-4bad-98b0-259ba0d08703 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Getting quotas for project cb4fb7d34a90445e9677ce7287759724. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:33:43.419357 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-4d79a5f4-e5b0-4bad-98b0-259ba0d08703 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Getting quotas for user 618d31fc46f64971af696b219e8848a3 and project cb4fb7d34a90445e9677ce7287759724. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:33:43.442476 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4d79a5f4-e5b0-4bad-98b0-259ba0d08703 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045830 Aug 10 12:33:43.443110 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 151/327] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:33:43 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:43.552529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-211740885", "imageRef": "73c28cc4-259f-405e-bba1-8d1d4fae361b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2127501302", "networks": [{"uuid": "5bf11b9e-ce66-4b66-9981-528746ab3fcc"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:43.605596 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] validate_networks() for [('5bf11b9e-ce66-4b66-9981-528746ab3fcc', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:33:43.605769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:33:43.606039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:33:43.606515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:33:43.606926 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:33:43.607872 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:33:43.616718 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:43.617193 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:43.617655 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:43.618377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:43.618829 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:43.619247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:43.636384 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Getting quotas for project 2301f937213e47c29686be4e8601ac32. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:33:43.640330 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Getting quotas for user 2aa6d6d56f9f4618ae3883c9beb2e77b and project 2301f937213e47c29686be4e8601ac32. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:33:43.651151 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:33:43.653491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:33:43.707925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-004207d0-7353-4635-8c60-26705a922228 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.240949 Aug 10 12:33:43.708740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 177/328] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:33:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 6242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:33:43.723879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-31f932cc-b76b-4261-94f0-2f41a7af41a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:43.724494 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-31f932cc-b76b-4261-94f0-2f41a7af41a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:43.781056 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-31f932cc-b76b-4261-94f0-2f41a7af41a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:43.788669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-31f932cc-b76b-4261-94f0-2f41a7af41a2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1245 microversion: 2.1 time: 0.073170 Aug 10 12:33:43.789610 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 178/329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:43 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:44.008814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:33:44.008968 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:33:44.009475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:33:44.009920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:33:44.010478 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:33:44.019455 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:44.019931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:44.020355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:44.021077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:44.022076 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:44.022812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:44.041402 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Getting quotas for project cb4fb7d34a90445e9677ce7287759724. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:33:44.046930 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Getting quotas for user 618d31fc46f64971af696b219e8848a3 and project cb4fb7d34a90445e9677ce7287759724. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:33:44.059848 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:33:44.062911 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73c28cc4-259f-405e-bba1-8d1d4fae361b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:33:44.115305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-42bfcb09-834c-4186-a8de-8b67e10d8822 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566589 Aug 10 12:33:44.116279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 152/330] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 12:33:44.128039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-11e27b8c-3f14-4f02-9c90-2834ce899958 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:44.128949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-11e27b8c-3f14-4f02-9c90-2834ce899958 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:44.188496 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-11e27b8c-3f14-4f02-9c90-2834ce899958 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:44.213099 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-11e27b8c-3f14-4f02-9c90-2834ce899958 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1258 microversion: 2.1 time: 0.089817 Aug 10 12:33:44.213727 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 179/331] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:44 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1258 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:44.418923 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:44.420315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:44.428393 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:44.429361 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:44.430004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:44.430986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:44.431705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:44.432336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:44.582701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:44.590586 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:44.592671 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:44.593857 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0f7e1d86-05d9-42cd-8371-ef6917aafdaf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1719 microversion: 2.20 time: 0.179695 Aug 10 12:33:44.594427 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 153/332] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:44 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:44.810030 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:44.810603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:44.817953 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:44.818471 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:44.818904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:44.819598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:44.820081 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:44.820500 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:44.914315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:44.922861 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-754822e3-511b-48d6-a6e0-e9a4e5c93aff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1297 microversion: 2.1 time: 0.116519 Aug 10 12:33:44.923592 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 180/333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:44 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1297 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:45.236041 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:45.236679 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:45.242618 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:45.243099 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:45.243530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:45.244217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:45.244671 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:45.245108 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:45.303741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:45.311417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3a5a0ef7-6403-4232-b595-e581ca8f9ef1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1254 microversion: 2.1 time: 0.079349 Aug 10 12:33:45.311978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 154/334] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:45 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1254 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:45.617871 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:45.618472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:45.625078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:45.625582 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:45.626015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:45.626730 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:45.627178 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:45.627597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:45.754067 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:45.761826 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:45.763345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:45.764492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-da239216-d199-4956-a56b-44740cd69966 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1719 microversion: 2.20 time: 0.150515 Aug 10 12:33:45.765041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 181/335] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:45 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:45.945638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:45.946251 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:45.952571 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:45.953055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:45.953544 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:45.954211 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:45.954669 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:45.955092 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:46.016280 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:46.023638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dcadda20-d22c-474b-a9af-accf765017b3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1305 microversion: 2.1 time: 0.081861 Aug 10 12:33:46.024195 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 155/336] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:45 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1305 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:46.332229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:46.332839 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:46.338808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:46.339289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:46.339724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:46.340412 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:46.340870 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:46.341943 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:46.399895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:46.407783 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cf0ddf82-4c9e-4e9a-a707-b45177078e96 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1254 microversion: 2.1 time: 0.079394 Aug 10 12:33:46.408339 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 182/337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:46 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1254 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:46.787704 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:46.788307 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:46.794321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:46.794820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:46.795263 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:46.795943 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:46.796394 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:46.796810 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:46.925385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:46.933165 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:46.934706 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:46.936388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f3fe1283-6631-4c86-9c3b-bcbe709811b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1719 microversion: 2.20 time: 0.152619 Aug 10 12:33:46.936944 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 156/338] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:46 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:47.043772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:47.044966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:47.050935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:47.051418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:47.051856 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:47.052545 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:47.053000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:47.053453 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:47.113103 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:47.120284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f9500ece-bccf-4307-a535-ab2840c515b1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1305 microversion: 2.1 time: 0.080364 Aug 10 12:33:47.120847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 183/339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:47 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1305 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:47.428401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:47.429036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:47.435496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:47.435990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:47.436430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:47.437132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:47.437615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:47.438043 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:47.497418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:47.504706 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c6607d9e-e990-40e3-b3d7-36a872ee67f8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1254 microversion: 2.1 time: 0.080514 Aug 10 12:33:47.505259 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 157/340] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:47 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1254 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:47.766765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-8aebca79-6791-4bfc-aba5-b765c143aa21 req-e918cac4-bc1a-4867-9de9-62d7208af45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2", "name": "network-vif-unplugged", "status": "completed", "tag": "dd060781-b144-4d67-99d5-c6d10616e60b"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:47.776057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-8aebca79-6791-4bfc-aba5-b765c143aa21 req-e918cac4-bc1a-4867-9de9-62d7208af45f service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:47.776527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-8aebca79-6791-4bfc-aba5-b765c143aa21 req-e918cac4-bc1a-4867-9de9-62d7208af45f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:47.776958 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-8aebca79-6791-4bfc-aba5-b765c143aa21 req-e918cac4-bc1a-4867-9de9-62d7208af45f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:47.788959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-8aebca79-6791-4bfc-aba5-b765c143aa21 req-e918cac4-bc1a-4867-9de9-62d7208af45f service nova] Creating event network-vif-unplugged:dd060781-b144-4d67-99d5-c6d10616e60b for instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 on hv-cinder-85226 Aug 10 12:33:47.793981 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-8aebca79-6791-4bfc-aba5-b765c143aa21 req-e918cac4-bc1a-4867-9de9-62d7208af45f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031364 Aug 10 12:33:47.794606 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 184/341] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:33:47.958787 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:47.959392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:47.967227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:47.967745 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:47.968206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:47.968894 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:47.969370 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:47.969791 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.111360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:48.119675 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:48.121309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:48.122618 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-de97ce30-5c8e-4643-abf8-30db6eda1ffc tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1722 microversion: 2.20 time: 0.167693 Aug 10 12:33:48.123255 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 158/342] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:47 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:48.144308 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:48.145329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:48.152165 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.152652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.153286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.154735 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.156242 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.156919 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.172660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62c841b0-ebc2-4d27-9401-d04db94c2993"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:48.175264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:48.185258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.186445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.186445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.186927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.187395 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.187826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.251300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:48.254806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:48.259861 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b4c2e66c-c699-4b00-910d-9107e1e3dc04 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1303 microversion: 2.1 time: 0.120579 Aug 10 12:33:48.260645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 185/343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:48 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:48.501861 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b7ff6092-7905-4193-8ebb-2960bb12d8d9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343906 Aug 10 12:33:48.502820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 159/344] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 10 12:33:48 2022] POST /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments => generated 188 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:33:48.525682 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:48.526569 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:48.533216 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.533819 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.534329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.535104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.535654 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.536167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.637715 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:48.638376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:48.639006 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:48.649092 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.649092 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.649567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.650106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.650557 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.650978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.658749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b34e9ffd-0f0c-4c64-885e-407f63fe32de tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1328 microversion: 2.1 time: 0.137379 Aug 10 12:33:48.659668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 186/345] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:48 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1328 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:48.707499 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118381) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 12:33:48.826819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-620b2667-4374-4b1c-8eab-9150125ec8a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/action" status: 202 len: 0 microversion: 2.20 time: 0.192364 Aug 10 12:33:48.827422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 160/346] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 10 12:33:48 2022] POST /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 12:33:48.837897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:48.839005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:48.854875 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.856935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.857910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:48.858911 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:48.859496 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:48.860191 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:49.151923 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:49.162425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:49.164258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:49.165619 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c91b6050-feda-4782-86dd-6a022b4ae0cf tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.332054 Aug 10 12:33:49.166351 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 187/347] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:48 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:33:49.284404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:49.285468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:49.300327 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:49.302268 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:49.303795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:49.306470 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:49.307751 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:49.309088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:49.546161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:49.557043 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d9699f51-daac-4bc4-9c84-dc7965bce71f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.279351 Aug 10 12:33:49.571241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 161/348] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:49 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:49.680984 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:49.681919 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:49.693814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:49.696779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:49.697455 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:49.698347 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:49.702033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:49.702716 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:49.833717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:49.844940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-988bb438-940f-41c7-988f-9508c21ca3d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1316 microversion: 2.1 time: 0.167874 Aug 10 12:33:49.846923 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 188/349] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:49 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:50.159247 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-1daded2c-8003-4391-9d7a-a1785e710a62 req-8a0d8c58-1daa-4adc-b1c3-e3e4bf385093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406145f8-c18f-42a6-ad69-122776fcde13", "tag": "925d1f21-e18a-4cdb-9515-0a2196cfef96"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:33:50.178147 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-1daded2c-8003-4391-9d7a-a1785e710a62 req-8a0d8c58-1daa-4adc-b1c3-e3e4bf385093 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:50.179373 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-1daded2c-8003-4391-9d7a-a1785e710a62 req-8a0d8c58-1daa-4adc-b1c3-e3e4bf385093 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:50.180977 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-1daded2c-8003-4391-9d7a-a1785e710a62 req-8a0d8c58-1daa-4adc-b1c3-e3e4bf385093 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:50.191339 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:50.191945 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:50.204813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:50.206301 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:50.207736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:50.210629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:50.211307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:50.212152 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:50.219914 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-1daded2c-8003-4391-9d7a-a1785e710a62 req-8a0d8c58-1daa-4adc-b1c3-e3e4bf385093 service nova] Creating event network-changed:925d1f21-e18a-4cdb-9515-0a2196cfef96 for instance 406145f8-c18f-42a6-ad69-122776fcde13 on hv-cinder-85226 Aug 10 12:33:50.242235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-1daded2c-8003-4391-9d7a-a1785e710a62 req-8a0d8c58-1daa-4adc-b1c3-e3e4bf385093 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086470 Aug 10 12:33:50.242883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 162/350] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:33:50.410889 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:50.421859 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:50.423499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:50.424865 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-afd466d7-272a-4add-ae59-3197a6b91abe tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.238946 Aug 10 12:33:50.425445 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 189/351] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:50 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:50.583870 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:50.585160 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:50.592378 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:50.592866 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:50.593315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:50.594017 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:50.594498 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:50.594918 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:50.731444 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:50.739210 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e99bd1f-cab9-4ac2-9e3a-5b0a52a6829b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.160114 Aug 10 12:33:50.739771 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 163/352] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:50 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:50.868268 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:50.868787 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:50.874863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:50.875350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:50.875792 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:50.876488 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:50.876942 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:50.877396 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:51.016415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:51.024045 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e6870db8-ba80-40d0-8b52-5e856b834960 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.159665 Aug 10 12:33:51.024706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 190/353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:50 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:51.448182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:51.448793 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:51.454911 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:51.455468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:51.455909 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:51.456636 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:51.457121 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:51.457595 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:51.593080 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:51.602126 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:51.603650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:51.604826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3bf79fb8-623f-49ee-a69e-d3bafa641fbb tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.160727 Aug 10 12:33:51.605401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 164/354] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:51 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:51.760985 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:51.761608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:51.768424 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:51.769230 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:51.769880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:51.770871 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:51.771573 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:51.772002 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:52.047027 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:52.047952 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:52.054685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:52.055176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:52.055618 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:52.056321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:52.056775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:52.057203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:52.061563 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:52.179430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:52.187229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3ddf0b2d-d01a-43d8-8d6a-b6d65e96dfde tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.430152 Aug 10 12:33:52.187797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 191/355] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:51 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:52.200321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:52.208148 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d5310fcd-c5d1-4f09-af09-3656057e8266 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.165581 Aug 10 12:33:52.208706 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 165/356] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:52 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:52.628204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:52.628811 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:52.634749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:52.635229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:52.635688 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:52.636378 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:52.636830 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:52.637249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:52.766345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:52.776088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:52.778043 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:52.779309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e63740a7-d175-41ea-a3f0-efaf7719aa5f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.155110 Aug 10 12:33:52.780209 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 192/357] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:52 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:53.207315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:53.207946 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:53.214301 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:53.214781 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:53.215216 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:53.215907 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:53.216340 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:53.216755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:53.228923 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:53.229746 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:53.236732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:53.237371 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:53.237964 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:53.238891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:53.239435 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:53.239931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:53.381993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:53.384428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:53.389728 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-086f507d-455b-42dc-b067-592833242d11 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.165267 Aug 10 12:33:53.393245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 193/358] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:53 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:53.393439 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b6a93ef6-1cdf-4af8-be6f-743a4c07030a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.189731 Aug 10 12:33:53.396015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 166/359] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:53 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:53.804940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:53.805877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:53.807905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:53.813438 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:53.813935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:53.814370 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:53.815065 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:53.815522 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:53.815966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:53.981175 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:53.989585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:53.991087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:53.992257 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2bc66360-94eb-4445-90c1-b5a86952eda6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.191363 Aug 10 12:33:53.992824 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 194/360] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:53 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:54.410637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:54.411258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:54.413114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:54.413791 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=14 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:54.414533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:54.415175 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:54.417104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=10 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:33:54.420402 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:54.420893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:54.421350 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:54.422186 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:54.422312 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:54.422683 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:54.422798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:54.423103 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:54.423283 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:54.424005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:54.424455 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:54.424886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:54.602238 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:54.611723 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-eb0dc535-c2ea-4f7d-8684-00ad12e51c0a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.204860 Aug 10 12:33:54.623268 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:54.625549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 167/361] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:54 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:54.631880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-105aadb6-6c35-4c2e-952f-e36dc1c3b1cb tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.221274 Aug 10 12:33:54.637790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 195/362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:54 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:55.017178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:55.017811 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:55.023851 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:55.024336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:55.024763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:55.025751 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:55.026430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:55.027076 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:55.175070 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:55.183509 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:55.185046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:55.186226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3a3eb2b5-a4ca-4717-a4b6-87732a64f64c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.173511 Aug 10 12:33:55.187408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 168/363] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:55 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:55.632310 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:55.632960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:55.638838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:55.639323 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:55.639760 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:55.641018 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:55.641505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:55.641936 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:55.653539 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:55.654772 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:55.661518 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:55.662235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:55.662896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:55.663787 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:55.664461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:55.665726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:55.834388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:55.840086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:55.842643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1be126e1-61cc-4758-b16b-354db732d441 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.192893 Aug 10 12:33:55.843453 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 169/364] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:55 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:55.848381 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-62d7b89d-b23a-42fd-a995-3c436cc69e63 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.219870 Aug 10 12:33:55.849641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 196/365] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:55 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:56.208652 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:56.209421 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:56.215380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:56.215871 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:56.216295 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:56.216981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:56.217472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:56.218380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:56.351920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:56.361884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:56.363640 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:56.364829 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-db910e93-1434-4039-a710-871cc34f34a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.160166 Aug 10 12:33:56.365465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 170/366] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:56 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:56.871891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:56.872493 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:56.881317 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:56.881317 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:56.881959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:56.881959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:56.881959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:56.881959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:56.882277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:56.882277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:56.886917 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:56.887409 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:56.887850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:56.888552 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:56.889008 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:56.889609 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:57.030052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:57.033129 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:57.038388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-daed667c-5d1b-4d91-9e7f-4aa23a3a0a82 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.164388 Aug 10 12:33:57.039175 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 171/367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:56 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:57.042864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8d5195c8-6f0e-4063-956f-dee743af0b53 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.174927 Aug 10 12:33:57.053736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 197/368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:56 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:57.389936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:57.390541 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:57.396449 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:57.396936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:57.397404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:57.398099 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:57.398559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:57.398990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:57.530543 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:57.539900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:57.541446 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:57.542622 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4834d7c2-83c9-4287-9801-037549ce1483 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.156632 Aug 10 12:33:57.543182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 172/369] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:57 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:58.059894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:58.060537 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:58.069159 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:58.069159 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:58.069159 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:58.069159 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:58.069958 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:58.070570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:58.077900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:58.078060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:58.078387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:58.078515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:58.078822 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:58.079521 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:58.079978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:58.080399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:58.245076 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:58.252426 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fb5787b8-4cee-45e1-8af7-ed2bdc12e2c8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.186186 Aug 10 12:33:58.252982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 173/370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:58 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:58.257743 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:58.265726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e5ada51e-6123-4163-843e-bead19b53993 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.209641 Aug 10 12:33:58.266272 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 198/371] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:58 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:58.566760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:58.567362 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:58.574799 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:58.575296 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:58.575732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:58.576438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:58.576897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:58.577990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:58.707672 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:58.716468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:58.718059 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:58.719223 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-84d9838a-37dc-4d17-a9dc-673c20049cd2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.156280 Aug 10 12:33:58.720101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 174/372] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:58 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:33:59.274312 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:59.276278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:59.283973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:59.284692 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:59.285078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:59.285898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:59.286418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:59.286936 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:59.287911 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:59.288515 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:59.295028 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:59.295509 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:59.295938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:59.297297 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:59.298211 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:59.298634 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:59.424864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:59.438918 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:59.439670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-17225769-b855-4a58-b10c-7a5db6dd86e7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.169910 Aug 10 12:33:59.440252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 199/373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:59 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:33:59.447671 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7376abe5-34a6-4766-89f7-7f1a7d8c54d9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.164065 Aug 10 12:33:59.448605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 175/374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:33:59 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:33:59.743810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:33:59.744411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:33:59.750317 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:59.750797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:59.751228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:59.751908 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:33:59.752357 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:33:59.752779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:33:59.890673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:59.899484 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:59.900989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:33:59.902183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-db53fe81-01c0-4ad2-9edc-5961ee13097b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.162246 Aug 10 12:33:59.902937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 200/375] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:33:59 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:00.222575 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:00.223073 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:00.229384 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:00.229970 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:00.230513 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:00.231379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:00.231898 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:00.232320 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:00.255130 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c7b4e93a-e353-44db-bb55-c64a99218cde tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/ips" status: 200 len: 146 microversion: 2.1 time: 0.036727 Aug 10 12:34:00.255691 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 176/376] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:34:00 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:00.459640 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:00.460247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:00.466229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:00.466711 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:00.467170 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:00.467872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:00.468311 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:00.468311 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:00.468498 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:00.468753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:00.475210 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:00.475693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:00.476128 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:00.476814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:00.477289 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:00.477717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:00.602766 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:00.604884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:00.610901 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6bd8061a-f65d-43ed-9b04-98fdd7c87f60 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.155077 Aug 10 12:34:00.611831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 201/377] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:00 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:00.612722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-71419d27-9ca4-4226-a5ef-46fe733e70d5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.148758 Aug 10 12:34:00.613281 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 177/378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:00 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:00.924857 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:00.925506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:00.931462 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:00.931949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:00.932393 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:00.933086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:00.933583 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:00.934017 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:00.951468 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:01.064996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:01.073593 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:01.075387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:01.076548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-94294a30-426b-4b6b-b402-93e867a93243 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1748 microversion: 2.20 time: 0.156146 Aug 10 12:34:01.077104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 202/379] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:00 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:01.631751 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:01.632480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:01.635202 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:01.635812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:01.639061 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:01.639612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:01.641260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:01.642161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:01.642285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:01.642732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:01.642844 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:01.643240 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:01.643426 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:01.643938 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:01.644387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:01.644807 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:01.780225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:01.787587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-105e492e-4d09-4eb5-bb0c-4afcf4c1dc9e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.159818 Aug 10 12:34:01.788153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 178/380] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:01 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:01.934554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:01.942635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-fb3b4de8-0790-48fa-928c-d5e8da412070 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.311294 Aug 10 12:34:01.943194 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 203/381] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:01 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:02.100590 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:02.101256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:02.107571 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:02.108093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:02.109054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:02.109779 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:02.110234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:02.110654 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:02.124233 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-6918c916-602d-412f-bf17-13782287d615 req-655c8867-ce80-4e2b-b981-845150e90dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc29cce-268e-4699-ad8d-7b096e9c30ed", "tag": "b96cc99c-2ad4-4023-a528-8c6512a0ba66"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:02.140649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6918c916-602d-412f-bf17-13782287d615 req-655c8867-ce80-4e2b-b981-845150e90dbf service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:02.141285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6918c916-602d-412f-bf17-13782287d615 req-655c8867-ce80-4e2b-b981-845150e90dbf service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:02.142169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6918c916-602d-412f-bf17-13782287d615 req-655c8867-ce80-4e2b-b981-845150e90dbf service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:02.155806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-6918c916-602d-412f-bf17-13782287d615 req-655c8867-ce80-4e2b-b981-845150e90dbf service nova] Creating event network-changed:b96cc99c-2ad4-4023-a528-8c6512a0ba66 for instance bfc29cce-268e-4699-ad8d-7b096e9c30ed on hv-cinder-85226 Aug 10 12:34:02.162087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-6918c916-602d-412f-bf17-13782287d615 req-655c8867-ce80-4e2b-b981-845150e90dbf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042834 Aug 10 12:34:02.162959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 204/382] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:34:02.450813 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:02.460054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:02.461992 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:02.463499 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-da86d1d7-9749-4b47-9612-38dd8b636594 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1750 microversion: 2.20 time: 0.367251 Aug 10 12:34:02.464054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 179/383] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:02 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1750 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:02.808685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:02.809413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:02.815571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:02.816057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:02.816491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:02.817184 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:02.817672 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:02.818099 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:02.942683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:02.950010 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ad61c386-8954-4e1c-8afa-a25623071e70 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.145552 Aug 10 12:34:02.950571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 205/384] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:02 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:02.962884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:02.963496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:02.969775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:02.970257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:02.970688 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:02.971373 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:02.972094 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:02.972519 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:03.097621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:03.104898 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-58875de5-1dc9-4d13-ae6d-28447f8abe2e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.145866 Aug 10 12:34:03.105661 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 180/385] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:02 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:03.487174 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:03.487582 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:03.493667 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:03.494290 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:03.494703 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:03.495473 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:03.495942 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:03.496370 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:03.646972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:03.655293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:03.656817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:03.657998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-029427d9-142d-4003-9aa9-3e71a8661b7f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.175633 Aug 10 12:34:03.658665 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 206/386] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:03 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:03.971935 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:03.972527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:03.978885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:03.979363 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:03.979797 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:03.980480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:03.980933 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:03.981385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:04.111947 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:04.119742 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dac8cb58-0caa-4486-a4c4-b9893ae72965 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.152436 Aug 10 12:34:04.120311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 181/387] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:03 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:04.125332 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:04.125868 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:04.131940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:04.132424 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:04.132887 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:04.133604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:04.134064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:04.134486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:04.261806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:04.269744 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3a617df0-b2fb-4c38-a947-51043be400ab tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.148279 Aug 10 12:34:04.270307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 207/388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:04 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:04.634606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df0a3a5-13e7-470b-a046-29f1cd451082"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:04.637101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:04.643709 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:04.644242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:04.644711 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:04.645426 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:04.645882 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:04.646304 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:04.649934 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:04.681013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:04.681651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:04.688191 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:04.688670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:04.689098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:04.689808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:04.690263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:04.690683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:04.816212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:04.824718 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:04.826394 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:04.828122 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c472fa89-fa10-42bd-a140-4e625bb30888 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.150397 Aug 10 12:34:04.828688 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 208/389] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:04 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:34:05.140033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:05.140626 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:05.146468 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:05.146952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:05.147395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:05.148393 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:05.148861 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:05.149312 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:05.276615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:05.284531 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6da13801-1d19-4aba-82c3-b696cb281461 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.148264 Aug 10 12:34:05.285095 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 209/390] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:05 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:05.295511 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:05.296198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:05.302265 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:05.302740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:05.303169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:05.303850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:05.304298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:05.304717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:05.430456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:05.438304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-266481a9-89ff-44be-8f82-8f4cbed2a29f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.146545 Aug 10 12:34:05.438865 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 210/391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:05 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:05.860070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:05.861316 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:05.864035 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:05.870197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:05.870915 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:05.871674 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:05.872665 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:05.873059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:05.873594 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:06.025687 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-56c4f06b-78b1-48df-b9a7-0d13b713cab6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.394635 Aug 10 12:34:06.026372 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 182/392] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:34:04 2022] POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/os-volume_attachments => generated 194 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:06.164407 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:06.173344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:06.174897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:06.176064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3bb3bd3f-631d-421e-8f0f-55b91e5037ac tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.323924 Aug 10 12:34:06.176627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 211/393] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:05 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:06.306538 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:06.307301 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:06.314557 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:06.315044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:06.315501 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:06.316192 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:06.316646 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:06.317065 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:06.451783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:06.460496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c8ca3287-4e1b-44a0-8e88-ac7cca47bcb8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.158503 Aug 10 12:34:06.460931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:06.461801 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 183/394] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:06 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:06.462366 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:06.468592 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:06.469190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:06.469749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:06.470550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:06.471080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:06.471852 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:06.899838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:06.907768 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-aa8161e6-f42c-4821-911a-cfc73a6bbffd tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.453083 Aug 10 12:34:06.908424 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 212/395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:06 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:07.198343 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:07.198945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:07.202917 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:07.206481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:07.206956 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:07.207387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:07.208067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:07.208517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:07.208933 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:07.343919 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:07.352673 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:07.354415 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:07.355595 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-60a033e6-eb6a-45c8-9058-014879b1c33b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.161035 Aug 10 12:34:07.356047 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 184/396] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:07 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:07.487948 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:07.489434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:07.504603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:07.505418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:07.506086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:07.506916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:07.507475 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:07.507994 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:07.683062 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:07.692468 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1861f4a3-e2b8-4f10-8764-431de7bbb612 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.209538 Aug 10 12:34:07.693365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 213/397] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:07 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:07.928656 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:07.929297 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:07.936424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:07.938813 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:07.939121 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:07.939964 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:07.940490 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:07.940988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:08.072444 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-cb30a701-2c11-4c3a-9a54-28f252dde08d req-31758898-881d-418c-ae1f-530eff8954f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406145f8-c18f-42a6-ad69-122776fcde13", "name": "network-vif-plugged", "status": "completed", "tag": "925d1f21-e18a-4cdb-9515-0a2196cfef96"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:08.105256 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-cb30a701-2c11-4c3a-9a54-28f252dde08d req-31758898-881d-418c-ae1f-530eff8954f1 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:08.109556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-cb30a701-2c11-4c3a-9a54-28f252dde08d req-31758898-881d-418c-ae1f-530eff8954f1 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:08.110422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-cb30a701-2c11-4c3a-9a54-28f252dde08d req-31758898-881d-418c-ae1f-530eff8954f1 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:08.137681 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-cb30a701-2c11-4c3a-9a54-28f252dde08d req-31758898-881d-418c-ae1f-530eff8954f1 service nova] Creating event network-vif-plugged:925d1f21-e18a-4cdb-9515-0a2196cfef96 for instance 406145f8-c18f-42a6-ad69-122776fcde13 on hv-cinder-85226 Aug 10 12:34:08.143143 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:08.144848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-cb30a701-2c11-4c3a-9a54-28f252dde08d req-31758898-881d-418c-ae1f-530eff8954f1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079552 Aug 10 12:34:08.145913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 214/398] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:34:08.151570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4ca4df21-0459-4f0b-b30d-ef1ba3fdb04c tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.227177 Aug 10 12:34:08.165093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 185/399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:07 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:08.379000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:08.379695 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:08.386719 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:08.387314 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:08.387818 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:08.388720 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:08.389441 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:08.390073 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:08.563493 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:08.572316 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:08.573906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:08.575182 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-968a540a-28c9-44fe-a8c3-18d29f5bf9f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.200409 Aug 10 12:34:08.577713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 215/400] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:08 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:08.714758 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:08.717202 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:08.726552 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:08.727202 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:08.727648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:08.728537 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:08.729044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:08.729483 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:08.908873 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:08.920253 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-50bceff1-e681-46d9-9c26-448126565a36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.209622 Aug 10 12:34:08.921116 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 186/401] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:08 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:09.174610 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:09.175221 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:09.181613 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:09.182109 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:09.182562 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:09.183264 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:09.183724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:09.184146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:09.339601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:09.348079 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e079d634-9514-47cd-a7d5-162762de3129 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.177920 Aug 10 12:34:09.354199 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 216/402] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:09 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:09.602141 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:09.602758 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:09.611129 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:09.611621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:09.612054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:09.612755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:09.613275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:09.613746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:09.760144 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:09.770452 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:09.771977 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:09.773158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cc374c2f-4b4d-44d1-917e-f7c526c8764e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.175297 Aug 10 12:34:09.773922 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 187/403] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:09 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:09.944085 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:09.944886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:09.951753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:09.953482 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:09.954185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:09.955789 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:09.956483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:09.957588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:10.141581 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:10.149599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5ccd75f5-862b-4e2f-95e2-ee06cd3a2df4 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.210649 Aug 10 12:34:10.161706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 217/404] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:09 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:10.174606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-fbf12cc2-ec47-415b-92e4-95f008a468ae req-a7a9e17c-42cd-4877-a19b-bab4242e6bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc29cce-268e-4699-ad8d-7b096e9c30ed", "name": "network-vif-plugged", "status": "completed", "tag": "b96cc99c-2ad4-4023-a528-8c6512a0ba66"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:10.185658 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fbf12cc2-ec47-415b-92e4-95f008a468ae req-a7a9e17c-42cd-4877-a19b-bab4242e6bf0 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:10.185873 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fbf12cc2-ec47-415b-92e4-95f008a468ae req-a7a9e17c-42cd-4877-a19b-bab4242e6bf0 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:10.186288 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fbf12cc2-ec47-415b-92e4-95f008a468ae req-a7a9e17c-42cd-4877-a19b-bab4242e6bf0 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:10.198005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-fbf12cc2-ec47-415b-92e4-95f008a468ae req-a7a9e17c-42cd-4877-a19b-bab4242e6bf0 service nova] Creating event network-vif-plugged:b96cc99c-2ad4-4023-a528-8c6512a0ba66 for instance bfc29cce-268e-4699-ad8d-7b096e9c30ed on hv-cinder-85226 Aug 10 12:34:10.203583 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-fbf12cc2-ec47-415b-92e4-95f008a468ae req-a7a9e17c-42cd-4877-a19b-bab4242e6bf0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036454 Aug 10 12:34:10.204529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 188/405] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:10.367978 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:10.368547 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:10.375160 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:10.375657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:10.376093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:10.376800 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:10.377258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:10.377708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:10.513619 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:10.521722 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3f74d902-882a-43c6-b973-725011cf6fd8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.157588 Aug 10 12:34:10.522282 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 218/406] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:10 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:10.797365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:10.797978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:10.804541 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:10.805018 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:10.805487 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:10.806181 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:10.806635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:10.807384 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:10.943062 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:10.951781 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:10.954229 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:10.955422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f88527f4-31b1-41bc-9ef0-6741946cb42c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.163070 Aug 10 12:34:10.955982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 189/407] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:10 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:34:11.171749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:11.172447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:11.178713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:11.178931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:11.179366 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:11.180064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:11.180515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:11.180939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:11.319031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:11.328391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0b0d4d47-61e9-4ee6-962f-8df43e26c368 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.159521 Aug 10 12:34:11.329165 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 219/408] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:11 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:11.542145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:11.542666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:11.548742 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:11.549225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:11.549686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:11.550377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:11.550832 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:11.551249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:11.699155 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:11.707160 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-70b0e68b-5d78-4543-a88a-846e4223e88a tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.168867 Aug 10 12:34:11.707897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 190/409] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:11 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:11.978765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:11.979372 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:11.986158 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:11.986650 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:11.987082 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:11.987811 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:11.988263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:11.988696 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:12.008315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:12.140852 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:12.149510 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:12.151035 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:12.152210 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cd613762-c0e2-4338-aaa3-b6401e2bbc7d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.177371 Aug 10 12:34:12.152774 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 220/410] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:11 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:12.350269 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:12.350979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:12.358227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:12.358732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:12.359181 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:12.359877 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:12.360338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:12.360763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:12.501491 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:12.508936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5ca5df7f-02e5-44a7-936e-ea867ee8d354 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.162902 Aug 10 12:34:12.509529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 191/411] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:12 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:12.729454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:12.730064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:12.736059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:12.736540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:12.736975 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:12.737706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:12.738163 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:12.738588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:12.877075 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:12.884952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7d02a7b5-215a-4f6f-b8df-1fa6baf11fe2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.159316 Aug 10 12:34:12.885689 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 221/412] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:12 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:13.176345 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:13.176942 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:13.182918 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:13.183396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:13.183826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:13.184509 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:13.185719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:13.186277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:13.326207 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:13.334974 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:13.336660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:13.337979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7b7926fc-a6dc-4346-ac9b-b507fbd3d2ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.165528 Aug 10 12:34:13.338628 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 192/413] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:13 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:13.531567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:13.532209 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:13.539306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:13.539797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:13.540230 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:13.541334 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:13.541795 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:13.542218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:13.682188 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:13.689671 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-822c2e5b-a586-4e23-b4b9-2de23aa81103 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.162540 Aug 10 12:34:13.690245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 222/414] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:13 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:13.906987 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:13.907536 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:13.913895 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:13.914386 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:13.914825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:13.915525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:13.915982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:13.916407 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:14.053320 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:14.060807 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bee594ec-53fb-4217-9ce2-cd0eaeb01162 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.158340 Aug 10 12:34:14.061509 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 193/415] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:13 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:14.362028 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:14.362746 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:14.369050 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:14.369570 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:14.370198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:14.370882 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:14.371312 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:14.371910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:14.506288 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:14.515803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:14.517437 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:14.518683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5dd0e9da-50dd-4f4e-94af-9d4bf9e71837 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.160583 Aug 10 12:34:14.519309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 223/416] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:14 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:14.709204 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:14.709840 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:14.716257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:14.716767 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:14.717188 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:14.717957 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:14.718421 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:14.718883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:14.851900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:14.860098 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-14228e44-dc08-4550-b0ad-c1c45dc85a5d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.154687 Aug 10 12:34:14.860850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 194/417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:14 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:15.081798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:15.082443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:15.088490 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:15.088976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:15.089438 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:15.090143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:15.090620 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:15.091047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:15.228597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:15.237083 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4b69ff9a-2111-4b94-8949-849cb12d1e9e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.159224 Aug 10 12:34:15.237818 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 224/418] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:15 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:15.541521 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:15.542154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:15.548581 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:15.549062 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:15.549537 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:15.550238 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:15.550691 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:15.551115 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:15.693812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:15.703584 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:15.705094 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:15.706307 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ec496419-3967-4ddc-896c-b1caf92a1f28 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.168830 Aug 10 12:34:15.707048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 195/419] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:15 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:15.880329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:15.880921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:15.887040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:15.887525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:15.887963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:15.888658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:15.889116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:15.890189 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:16.031611 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:16.041021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d1e8873d-a021-42fb-920a-df8ff4273e91 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.164616 Aug 10 12:34:16.041621 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 225/420] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:15 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:16.257625 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:16.258243 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:16.265716 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:16.266042 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:16.267105 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:16.267206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:16.267612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:16.268258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:16.405165 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:16.412631 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-54229abd-4b43-4ddf-8cfc-2b6dc72d43ce tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.158775 Aug 10 12:34:16.413526 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 196/421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:16 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:16.728513 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:16.729123 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:16.735816 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:16.736302 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:16.736738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:16.737454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:16.738181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:16.738783 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:16.872010 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:16.880670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:16.882224 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:16.883374 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-13ab8ba6-1320-4f2f-a488-205d06210118 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.158767 Aug 10 12:34:16.883928 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 226/422] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:16 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:17.061903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:17.062518 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:17.068864 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:17.069383 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:17.069825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:17.070526 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:17.070988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:17.071417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:17.206092 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:17.213404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-290d9f90-b614-4786-b092-dd5f2c8507d3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.155337 Aug 10 12:34:17.213965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 197/423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:17 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:17.435882 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:17.437135 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:17.446717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:17.447213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:17.447644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:17.448532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:17.448991 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:17.449604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:17.576700 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:17.584651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-04aef117-7c81-45a8-a9df-1f58631b3f93 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.154799 Aug 10 12:34:17.585206 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 227/424] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:17 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:17.907531 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:17.908411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:17.914971 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:17.915193 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:17.915801 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:17.916489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:17.917108 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:17.917406 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:17.922806 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:18.051978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:18.060161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:18.061725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:18.062872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c3e52277-e22e-49a2-a202-b840158d6761 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.159775 Aug 10 12:34:18.063417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 198/425] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:17 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:18.234503 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:18.235109 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:18.241006 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:18.241483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:18.241900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:18.242584 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:18.243042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:18.243463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:18.369657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:18.378530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d8fec54c-995a-4faa-ae0b-351cf3dd100d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.147942 Aug 10 12:34:18.379092 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 228/426] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:18 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:18.605237 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:18.606142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:18.613642 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:18.614119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:18.615257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:18.616623 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:18.617082 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:18.617532 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:18.747845 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:18.755227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fc824976-ed43-4d18-ab4b-ae3946c5f1a8 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.153867 Aug 10 12:34:18.755794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 199/427] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:18 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:19.086020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:19.086608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:19.093580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:19.094077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:19.094520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:19.095258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:19.095720 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:19.096151 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:19.228648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:19.237080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:19.238637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:19.239801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d98a5531-5924-4f4e-8e97-dad494e39ad6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.158427 Aug 10 12:34:19.240363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 229/428] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:19 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:19.398692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:19.399214 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:19.405724 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:19.406211 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:19.406643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:19.407329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:19.407783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:19.408206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:19.531878 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:19.539420 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-66ba9e07-7cf6-4682-8d2b-92b902d89c2b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.144672 Aug 10 12:34:19.539985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 200/429] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:19 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:19.776165 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:19.776817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:19.783594 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:19.784116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:19.784555 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:19.785303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:19.785765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:19.786192 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:19.913873 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:19.921730 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4d66f64f-57de-4b71-8844-54c5142dc11d tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.149615 Aug 10 12:34:19.922285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 230/430] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:19 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:19.958414 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c239b947-7daa-4164-8c98-9f769487d680 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:19.964742 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c239b947-7daa-4164-8c98-9f769487d680 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:19.965225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c239b947-7daa-4164-8c98-9f769487d680 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:19.965694 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c239b947-7daa-4164-8c98-9f769487d680 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:20.024120 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c239b947-7daa-4164-8c98-9f769487d680 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Going to try to stop instance {{(pid=118381) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 12:34:20.064960 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c239b947-7daa-4164-8c98-9f769487d680 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/action" status: 202 len: 0 microversion: 2.1 time: 0.110141 Aug 10 12:34:20.065510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 201/431] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:34:19 2022] POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:34:20.073567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:20.074181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:20.080576 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:20.081087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:20.081556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:20.082245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:20.082701 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:20.083125 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:20.213062 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:20.222521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5929962f-b07a-4ce7-bb99-6669b838bb70 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.152688 Aug 10 12:34:20.223264 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 231/432] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:20 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:20.263452 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:20.264152 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:20.270226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:20.270713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:20.271150 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:20.271835 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:20.272295 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:20.272719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:20.406745 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:20.415006 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:20.416505 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:20.417670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3cc5bd6b-1538-4fec-8f23-3e10a2c010e7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.158595 Aug 10 12:34:20.418229 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 202/433] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:20 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:20.559865 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:20.560469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:20.566393 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:20.566869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:20.567301 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:20.567979 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:20.568430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:20.568854 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:20.695808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:20.703591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b9f59e42-f453-4c28-8fd3-7416024c0970 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1370 microversion: 2.1 time: 0.147521 Aug 10 12:34:20.704145 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 232/434] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:20 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:20.942074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:20.942766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:20.948643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:20.949120 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:20.949591 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:20.950276 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:20.950728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:20.951151 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.081563 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:21.088894 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2166404a-2ecd-49e9-a466-f5f3b1aaf6c1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1358 microversion: 2.1 time: 0.150672 Aug 10 12:34:21.089510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 203/435] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:20 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:21.246071 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:21.246610 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:21.252551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:21.253039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:21.253576 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.254273 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:21.254734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:21.255165 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.382065 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:21.390605 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-26e0ba3b-e2f6-4f97-83ce-f427be475d4a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.148503 Aug 10 12:34:21.391164 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 233/436] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:21 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:21.440392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:21.440989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:21.446937 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:21.447419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:21.447852 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.448542 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:21.448989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:21.449437 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.576278 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:21.585145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:21.586672 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:21.587854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e157360c-1b5a-4b39-a80b-bc96d048adc9 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.151964 Aug 10 12:34:21.588404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 204/437] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:21 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:21.724049 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:21.724655 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:21.730615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:21.731100 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:21.731591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.732278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:21.732734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:21.733221 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.861244 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:21.868669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-db7f2e33-cfd2-4119-8cf7-4bf35ebba017 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1563 microversion: 2.1 time: 0.148710 Aug 10 12:34:21.869229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 234/438] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:21 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:21.888982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:21.890136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:21.896387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:21.896876 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:21.897365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.898061 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:21.898525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:21.898951 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:21.973439 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-43c1e55c-7b64-4002-ad5a-a7d5bc7ec3b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088182 Aug 10 12:34:21.974033 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 205/439] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 10 12:34:21 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:22.110645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:22.111336 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:22.118012 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.118495 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.119289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.119982 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.120443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.120873 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.255912 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:22.263246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c7c5f121-78fb-431d-b4f5-7cc47b622e97 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1549 microversion: 2.1 time: 0.157149 Aug 10 12:34:22.263808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 235/440] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:22 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:22.284222 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:22.284863 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:22.290745 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.291231 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.291668 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.292372 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.292818 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.293258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.411644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:22.412653 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:22.419011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.419505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.419944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.421338 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.421803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.422234 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.521800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:22.530530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d04f2933-1192-43fa-ae36-0b32dc01b808 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1549 microversion: 2.1 time: 0.250109 Aug 10 12:34:22.531110 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 206/441] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:22 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1549 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:22.551335 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:22.556072 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:22.556845 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Searching by: {'deleted': False, 'project_id': 'cb4fb7d34a90445e9677ce7287759724'} {{(pid=118381) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 12:34:22.563615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.566646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:22.574532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0e0ad459-60e3-43a6-93f4-745aaceb6a8a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.166937 Aug 10 12:34:22.577841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 236/442] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:22 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:22.577975 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.577975 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.577975 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.577975 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.578270 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.611673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:22.612364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:22.619219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.619792 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.620292 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.621052 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.621797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.622289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.626446 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:22.680054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.multi_cell_list [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118381) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 12:34:22.756305 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:22.765187 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:22.766950 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:22.768101 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-76e1027d-b735-4e79-aede-6a4d2a7956f2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.160939 Aug 10 12:34:22.768648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 237/443] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:22 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:34:22.776284 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5f3e7e2f-ab34-4135-85f2-0037454c34bf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.228669 Aug 10 12:34:22.777050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 207/444] 10.222.0.65 () {58 vars in 1125 bytes} [Wed Aug 10 12:34:22 2022] GET /compute/v2.1/servers => generated 342 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:34:22.788505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:22.789246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:22.795217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.796274 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.796705 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.797419 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:22.797872 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:22.798287 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:22.929646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:22.937245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-332bab50-3a1d-413a-bb1f-0d3dd8b8bb0b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1549 microversion: 2.1 time: 0.152441 Aug 10 12:34:22.937773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 238/445] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:22 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:22.999750 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-31c1b255-f142-4d29-bbf0-6092d28a968a req-d90b9026-8988-4abe-bc40-9a9a477eb650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406145f8-c18f-42a6-ad69-122776fcde13", "tag": "925d1f21-e18a-4cdb-9515-0a2196cfef96"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:23.010768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-31c1b255-f142-4d29-bbf0-6092d28a968a req-d90b9026-8988-4abe-bc40-9a9a477eb650 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:23.011321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-31c1b255-f142-4d29-bbf0-6092d28a968a req-d90b9026-8988-4abe-bc40-9a9a477eb650 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:23.011810 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-31c1b255-f142-4d29-bbf0-6092d28a968a req-d90b9026-8988-4abe-bc40-9a9a477eb650 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:23.023508 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-31c1b255-f142-4d29-bbf0-6092d28a968a req-d90b9026-8988-4abe-bc40-9a9a477eb650 service nova] Creating event network-changed:925d1f21-e18a-4cdb-9515-0a2196cfef96 for instance 406145f8-c18f-42a6-ad69-122776fcde13 on hv-cinder-85226 Aug 10 12:34:23.028384 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-31c1b255-f142-4d29-bbf0-6092d28a968a req-d90b9026-8988-4abe-bc40-9a9a477eb650 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032263 Aug 10 12:34:23.029244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 208/446] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:34:23.596418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:23.597990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:23.606769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:23.607263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:23.607699 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:23.608476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:23.608927 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:23.609373 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:23.778738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:23.788046 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-446bfa80-963f-4c79-ac47-14a39da82c53 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.196048 Aug 10 12:34:23.788796 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 239/447] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:23 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:23.791872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:23.792726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:23.802438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:23.802929 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:23.803367 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:23.804100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:23.804562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:23.804982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:23.947508 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:23.956969 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:23.958637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:23.959891 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9f912df0-993d-4766-859c-bcf4a30b988a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.172637 Aug 10 12:34:23.960527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 209/448] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:23 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:34:24.551328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bf5f438-1a48-4f13-b08c-35589339a039"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:24.553761 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:24.559646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:24.560125 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:24.560556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:24.561929 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:24.562388 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:24.562864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:24.809515 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:24.810124 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:24.816527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:24.817005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:24.818225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:24.819109 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:24.819581 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:24.820009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:24.948312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:24.956397 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bab68a1e-f06a-486a-a62a-5437479be510 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.150679 Aug 10 12:34:24.956965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 210/449] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:24 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:24.982308 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:24.982911 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:24.989315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:24.989806 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:24.990247 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:24.990938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:24.991395 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:24.991825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:25.122975 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:25.131385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:25.132897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:25.134083 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cdc8f1d2-8aad-4427-bd28-749cdd84edaa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.155350 Aug 10 12:34:25.134632 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 211/450] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:24 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:34:25.599608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6ca93e9d-8237-4b7b-b9e0-ad41cfcd8dd1 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "POST /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.051827 Aug 10 12:34:25.600228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 240/451] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:34:24 2022] POST /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments => generated 194 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:25.978301 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:25.978918 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:25.985284 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:25.985778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:25.986217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:25.986915 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:25.987378 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:25.987806 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:26.117828 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:26.125789 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dd3d05eb-691c-441c-9a1f-1fcc0029d93c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.151457 Aug 10 12:34:26.126359 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 212/452] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:25 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:26.158480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:26.159196 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:26.168340 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:26.169215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:26.170053 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:26.171270 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:26.171811 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:26.172452 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:26.302060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:26.310628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:26.312181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:26.313369 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d3acd134-87e6-4d6e-a953-9c3d286539c3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.160194 Aug 10 12:34:26.323603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 241/453] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:26 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:27.147672 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:27.148613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:27.157247 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:27.157768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:27.158242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:27.159011 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:27.159550 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:27.160053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:27.287808 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:27.295619 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-39df7617-7f44-4457-b87c-048953f03d0d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.151737 Aug 10 12:34:27.296695 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 213/454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:27 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:27.335909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:27.336538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:27.343635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:27.344113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:27.344545 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:27.345231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:27.345708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:27.346131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:27.475561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:27.483751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:27.485257 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:27.486422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4938674f-1763-4a01-8713-b42774ca1c4b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.154482 Aug 10 12:34:27.486972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 242/455] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:27 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:28.316477 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:28.317091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:28.323417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:28.323899 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:28.324334 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:28.325021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:28.325512 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:28.325938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:28.343075 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:28.455355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:28.463228 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ed6cc95c-1f75-4b2d-97a8-bd482cc793cd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.150554 Aug 10 12:34:28.463793 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 214/456] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:28 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:28.507824 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:28.508430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:28.514702 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:28.515185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:28.515619 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:28.516307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:28.516760 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:28.517185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:28.646724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:28.655575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:28.657073 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:28.658305 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c9e073a3-a102-4670-9405-9b4c4b9258b3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.154298 Aug 10 12:34:28.658852 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 243/457] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:28 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:29.485671 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:29.486279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:29.492592 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:29.493068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:29.493527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:29.494234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:29.494684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:29.495101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:29.624215 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:29.632028 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5bb01acd-c6eb-423e-9abf-02dd3ef5e794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.150854 Aug 10 12:34:29.632589 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 215/458] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:29 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:29.681102 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:29.681736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:29.688032 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:29.688522 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:29.688959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:29.689675 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:29.690131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:29.690557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:29.816038 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:29.824355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:29.825891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:29.827534 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f99d9601-7282-4310-85b1-6ff2bd04a54f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.149769 Aug 10 12:34:29.828088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 244/459] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:29 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:34:30.176153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-50148bb3-9d34-46d0-b88b-ee81582795d1 req-2afb856c-a550-4e1b-93e0-c18f30032363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2", "name": "network-vif-plugged", "status": "completed", "tag": "dd060781-b144-4d67-99d5-c6d10616e60b"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:30.186551 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-50148bb3-9d34-46d0-b88b-ee81582795d1 req-2afb856c-a550-4e1b-93e0-c18f30032363 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:30.187004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-50148bb3-9d34-46d0-b88b-ee81582795d1 req-2afb856c-a550-4e1b-93e0-c18f30032363 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:30.187403 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-50148bb3-9d34-46d0-b88b-ee81582795d1 req-2afb856c-a550-4e1b-93e0-c18f30032363 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:30.198489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-50148bb3-9d34-46d0-b88b-ee81582795d1 req-2afb856c-a550-4e1b-93e0-c18f30032363 service nova] Creating event network-vif-plugged:dd060781-b144-4d67-99d5-c6d10616e60b for instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 on hv-cinder-85226 Aug 10 12:34:30.203965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-50148bb3-9d34-46d0-b88b-ee81582795d1 req-2afb856c-a550-4e1b-93e0-c18f30032363 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031463 Aug 10 12:34:30.204619 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 216/460] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:30.653583 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:30.654298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:30.660403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:30.660890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:30.661356 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:30.662055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:30.662510 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:30.662935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:30.803007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:30.810916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7d4cd53d-005d-429e-aaab-621fe561759c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.161190 Aug 10 12:34:30.811488 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 245/461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:30 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:30.852328 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:30.852976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:30.859538 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:30.860019 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:30.860449 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:30.861130 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:30.861608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:30.862023 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:30.989316 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:30.997590 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:30.999121 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:31.000258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0fee26f6-eb0a-40e3-84c4-4d61ef692b06 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.152678 Aug 10 12:34:31.000809 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 217/462] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:30 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:31.832507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:31.833119 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:31.839670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:31.840151 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:31.840589 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:31.841291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:31.841751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:31.842176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:31.970288 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:31.978514 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d29cd4df-cf3d-45e7-85bb-a447aa1141f9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.149826 Aug 10 12:34:31.979075 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 246/463] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:31 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:32.022507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:32.023158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:32.029567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:32.030036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:32.030467 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:32.031183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:32.031636 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:32.032058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:32.161382 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:32.169863 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:32.171479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:32.172581 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8c232c44-9e2e-4252-9a22-e04080aee5ce tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.153949 Aug 10 12:34:32.173139 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 218/464] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:32 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:33.000414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:33.001088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:33.007813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:33.008247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:33.008685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:33.009414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:33.009871 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:33.010376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:33.161619 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:33.169350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ca579f47-05b0-4c81-9207-1d438bb39269 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.173433 Aug 10 12:34:33.169911 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 247/465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:32 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:33.195166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:33.195774 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:33.197783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:33.204335 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:33.204823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:33.205357 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:33.206058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:33.206511 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:33.206936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:33.340618 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:33.349222 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:33.350826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:33.352009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-979d0722-7bb1-4e21-8fc8-1eb9a4d28573 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1806 microversion: 2.20 time: 0.160718 Aug 10 12:34:33.352557 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 219/466] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:33 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:34.191042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:34.191656 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:34.198313 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:34.198801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:34.199258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:34.199998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:34.200454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:34.200880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:34.335484 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:34.343821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1b832ec1-0d7f-4e1f-ab20-8b3f93ba04f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.156670 Aug 10 12:34:34.344377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 248/467] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:34 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:34.374886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:34.375611 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:34.382187 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:34.382678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:34.383114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:34.383810 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:34.384264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:34.384689 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:34.510807 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:34.519708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:34.521235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:34.522418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-72ec4c41-8750-4ccf-bfb0-c5e60679127e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1793 microversion: 2.20 time: 0.151667 Aug 10 12:34:34.522974 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 220/468] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:34:34 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1793 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:35.305530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:35.306142 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:35.312999 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:35.313510 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:35.313951 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:35.314641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:35.315098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:35.315525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:35.364942 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:35.365678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:35.371787 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:35.372385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:35.372839 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:35.374120 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:35.374540 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:35.374970 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:35.443756 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:35.452278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6f184292-f2e4-4d3b-92b3-c3f0968aaf87 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1595 microversion: 2.1 time: 0.150008 Aug 10 12:34:35.452852 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 249/469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:35 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1595 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:35.508926 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:35.517834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-db297119-281c-4576-9d95-7a3889b53e3e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1724 microversion: 2.1 time: 0.156633 Aug 10 12:34:35.518403 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 221/470] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:35 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:36.539778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:36.540424 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:36.549858 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=78 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:36.551381 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.551921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.552371 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.553464 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.554003 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.554460 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.575685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:36.577789 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:36.586340 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.587250 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.587795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.588501 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.588954 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.589459 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.618857 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9103b1b6-1247-4421-abb8-2d51b7fa75d3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235/ips" status: 200 len: 150 microversion: 2.1 time: 0.048593 Aug 10 12:34:36.619430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 222/471] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:34:36 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:36.632287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d651b075-70a7-48ee-8b35-acfbe2a0c10e"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:36.634756 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:36.641217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.641739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.642179 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.642873 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.643334 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.643760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.724362 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Invalid volume: volume d651b075-70a7-48ee-8b35-acfbe2a0c10e is already attached to instances: 7e6bf86e-2553-4f1c-8620-92c63510184a Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: POST /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235/os-volume_attachments HTTP/1.1 Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 74 Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:34:36.726249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {"volumeAttachment": {"volumeId": "d651b075-70a7-48ee-8b35-acfbe2a0c10e"}} Aug 10 12:34:36.727570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Invalid volume: volume d651b075-70a7-48ee-8b35-acfbe2a0c10e is already attached to instances: 7e6bf86e-2553-4f1c-8620-92c63510184a Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'server_id': '6264d236-8e5e-4e84-818f-10b9a8c54235', 'body': {'volumeAttachment': {'volumeId': 'd651b075-70a7-48ee-8b35-acfbe2a0c10e'}}} Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d651b075-70a7-48ee-8b35-acfbe2a0c10e is already attached to instances: 7e6bf86e-2553-4f1c-8620-92c63510184a Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:36.728434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d651b075-70a7-48ee-8b35-acfbe2a0c10e is already attached to instances: 7e6bf86e-2553-4f1c-8620-92c63510184a Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:36.729995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:34:36.732077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:34:36.732077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:34:36.732077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:34:36.732077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d651b075-70a7-48ee-8b35-acfbe2a0c10e is already attached to instances: 7e6bf86e-2553-4f1c-8620-92c63510184a Aug 10 12:34:36.732077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:36.732077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 400 to user: Invalid volume: volume d651b075-70a7-48ee-8b35-acfbe2a0c10e is already attached to instances: 7e6bf86e-2553-4f1c-8620-92c63510184a {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:34:36.732077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-abe238bb-36b6-41f7-91b4-7006ccf80d93 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099246 Aug 10 12:34:36.732077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 223/472] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:34:36 2022] POST /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 12:34:36.736190 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:36.736689 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:36.743255 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.743746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.744186 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.744888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.745373 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.745803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.770571 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:34:36.848751 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2ed3432c-3dbb-4049-9e52-aff6f48739ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 204 len: 0 microversion: 2.1 time: 0.115796 Aug 10 12:34:36.849242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 224/473] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:34:36 2022] DELETE /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 12:34:36.858355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:36.859049 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:36.865062 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.865593 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.866027 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:36.866726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:36.867177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:36.867597 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:37.005071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:37.012681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3fb2454d-406b-4aea-8e79-25e4d15f0e5c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1681 microversion: 2.1 time: 0.158509 Aug 10 12:34:37.013231 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 225/474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:36 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:37.061621 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:37.069843 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1adc83d4-debd-4299-8719-34172aaec9b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1701 microversion: 2.1 time: 0.533855 Aug 10 12:34:37.070418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 250/475] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:36 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1701 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:37.090528 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bbb25f53-6a0e-4ac4-ab63-580ec039309a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:37.096836 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bbb25f53-6a0e-4ac4-ab63-580ec039309a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:37.097354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bbb25f53-6a0e-4ac4-ab63-580ec039309a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:37.097786 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bbb25f53-6a0e-4ac4-ab63-580ec039309a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:37.119504 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bbb25f53-6a0e-4ac4-ab63-580ec039309a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Going to try to start instance {{(pid=118381) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 12:34:37.163699 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bbb25f53-6a0e-4ac4-ab63-580ec039309a tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/action" status: 202 len: 0 microversion: 2.1 time: 0.076771 Aug 10 12:34:37.164703 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 226/476] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:34:37 2022] POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:34:37.173073 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:37.173703 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:37.179473 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:37.179959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:37.180398 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:37.181086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:37.181582 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:37.182037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:37.400814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:37.409081 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1328ea81-edb0-4c48-89c1-7dc8a48af125 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1710 microversion: 2.1 time: 0.240042 Aug 10 12:34:37.410261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 251/477] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:37 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1710 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:37.469898 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-26d0b089-1bec-485c-90fd-9e2b89c27100 req-7784290d-7a96-439c-bb2d-c11fcc1cca53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc29cce-268e-4699-ad8d-7b096e9c30ed", "tag": "b96cc99c-2ad4-4023-a528-8c6512a0ba66"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:37.475017 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:37.482185 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-26d0b089-1bec-485c-90fd-9e2b89c27100 req-7784290d-7a96-439c-bb2d-c11fcc1cca53 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:37.482688 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-26d0b089-1bec-485c-90fd-9e2b89c27100 req-7784290d-7a96-439c-bb2d-c11fcc1cca53 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:37.483774 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-26d0b089-1bec-485c-90fd-9e2b89c27100 req-7784290d-7a96-439c-bb2d-c11fcc1cca53 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:37.495757 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-26d0b089-1bec-485c-90fd-9e2b89c27100 req-7784290d-7a96-439c-bb2d-c11fcc1cca53 service nova] Creating event network-changed:b96cc99c-2ad4-4023-a528-8c6512a0ba66 for instance bfc29cce-268e-4699-ad8d-7b096e9c30ed on hv-cinder-85226 Aug 10 12:34:37.501080 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-26d0b089-1bec-485c-90fd-9e2b89c27100 req-7784290d-7a96-439c-bb2d-c11fcc1cca53 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035743 Aug 10 12:34:37.502015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 227/478] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:38.035788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:38.037905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:38.044647 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:38.045931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:38.046580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:38.047644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:38.048309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:38.048744 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:38.067774 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:38.235828 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:38.244167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6e594c0d-0780-41aa-862d-1edbd2272447 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1681 microversion: 2.1 time: 0.213743 Aug 10 12:34:38.257879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 252/479] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:38 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:38.432377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:38.433208 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:38.442486 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:38.443456 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:38.444168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:38.445328 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:38.446521 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:38.447264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:38.555275 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1585465032"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:38.556387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:38.563597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:38.564091 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:38.564533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:38.565242 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:38.565798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:38.566235 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:38.621132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:38.633349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b03e405e-50ef-4aa6-8437-f0441da81df3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1710 microversion: 2.1 time: 0.206040 Aug 10 12:34:38.645741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 228/480] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:38 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1710 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:38.738396 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.network.security_group_api [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Adding security group 8e8309a9-8bd7-40a0-8ddc-8d4e438b16cd to port b96cc99c-2ad4-4023-a528-8c6512a0ba66 Aug 10 12:34:39.267128 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:39.267750 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:39.274299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:39.274794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:39.275227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:39.275931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:39.277226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:39.277694 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:39.493011 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:39.501582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-618653d0-ffa5-463d-b86f-a7bb587b8705 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1681 microversion: 2.1 time: 0.238233 Aug 10 12:34:39.502178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 229/481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:39 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:39.632515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-98611baa-d831-4787-9581-d15a88a571f5 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "POST /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/action" status: 202 len: 0 microversion: 2.1 time: 1.081061 Aug 10 12:34:39.637293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 253/482] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:34:38 2022] POST /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/action => generated 0 bytes in 1086 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:34:39.642585 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:39.643447 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:39.653728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:39.654323 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:39.655396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:39.658425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:39.659216 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:39.659359 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:39.659906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:39.660442 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:39.666692 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:39.668751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:39.669413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:39.670429 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:39.671692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:39.672883 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:39.673678 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:39.882127 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:39.894709 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-652c5df2-113b-4ed4-a651-232941368f31 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1642 microversion: 2.1 time: 0.256449 Aug 10 12:34:39.895605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 230/483] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:39 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1642 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:39.902700 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-105e7e5f-519b-41f1-836f-709398b53c98 req-632f4066-4f9a-42d5-910b-e1d16599d30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc29cce-268e-4699-ad8d-7b096e9c30ed", "tag": "b96cc99c-2ad4-4023-a528-8c6512a0ba66"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:39.916201 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-105e7e5f-519b-41f1-836f-709398b53c98 req-632f4066-4f9a-42d5-910b-e1d16599d30e service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:39.917169 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-105e7e5f-519b-41f1-836f-709398b53c98 req-632f4066-4f9a-42d5-910b-e1d16599d30e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:39.917637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-105e7e5f-519b-41f1-836f-709398b53c98 req-632f4066-4f9a-42d5-910b-e1d16599d30e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:39.930989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-105e7e5f-519b-41f1-836f-709398b53c98 req-632f4066-4f9a-42d5-910b-e1d16599d30e service nova] Creating event network-changed:b96cc99c-2ad4-4023-a528-8c6512a0ba66 for instance bfc29cce-268e-4699-ad8d-7b096e9c30ed on hv-cinder-85226 Aug 10 12:34:39.936335 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-105e7e5f-519b-41f1-836f-709398b53c98 req-632f4066-4f9a-42d5-910b-e1d16599d30e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039673 Aug 10 12:34:39.936931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 231/484] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:40.021902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:40.032383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-606c44ee-98ff-439b-9c07-c17ec637f122 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1710 microversion: 2.1 time: 0.380053 Aug 10 12:34:40.044065 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 254/485] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:39 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1710 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:40.525889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:40.527894 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:40.537052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:40.538506 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:40.539226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:40.540587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:40.541055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:40.541510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:40.617594 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:40.626770 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-697a4e33-0138-42c9-b17d-5b83e45e7bd8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1613 microversion: 2.1 time: 0.107150 Aug 10 12:34:40.628604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 232/486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:40 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1613 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:41.054413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:41.055049 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:41.062226 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:41.062924 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:41.063363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:41.064060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:41.064524 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:41.064949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:41.199404 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:41.214773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d97e5d90-d5ed-4233-9bee-aa39f09bed59 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1714 microversion: 2.1 time: 0.162184 Aug 10 12:34:41.215477 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 255/487] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:41 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:41.647938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:41.648540 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:41.655949 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:41.656429 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:41.656859 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:41.657707 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:41.658192 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:41.658659 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:41.697466 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:41.697947 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:41.698375 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:41.698835 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lazy-loading 'fault' on Instance uuid 6264d236-8e5e-4e84-818f-10b9a8c54235 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:34:41.753009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:41.761619 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-92af336c-9bf4-43fe-afc0-1809b451701a tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 200 len: 1330 microversion: 2.1 time: 0.117633 Aug 10 12:34:41.762392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 233/488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:41 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:41.957781 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-6180d9cb-676c-4e79-af7a-7c91a2d4a7d0 req-162a184e-48fc-472a-9acf-aec79a349354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6264d236-8e5e-4e84-818f-10b9a8c54235", "name": "network-vif-deleted", "tag": "5082193a-c1c4-4193-a2e4-4f3ddef91ba7"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:41.967634 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6180d9cb-676c-4e79-af7a-7c91a2d4a7d0 req-162a184e-48fc-472a-9acf-aec79a349354 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:41.968090 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6180d9cb-676c-4e79-af7a-7c91a2d4a7d0 req-162a184e-48fc-472a-9acf-aec79a349354 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:41.968507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6180d9cb-676c-4e79-af7a-7c91a2d4a7d0 req-162a184e-48fc-472a-9acf-aec79a349354 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:41.980331 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-6180d9cb-676c-4e79-af7a-7c91a2d4a7d0 req-162a184e-48fc-472a-9acf-aec79a349354 service nova] Creating event network-vif-deleted:5082193a-c1c4-4193-a2e4-4f3ddef91ba7 for instance 6264d236-8e5e-4e84-818f-10b9a8c54235 on hv-cinder-85226 Aug 10 12:34:41.985414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-6180d9cb-676c-4e79-af7a-7c91a2d4a7d0 req-162a184e-48fc-472a-9acf-aec79a349354 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031247 Aug 10 12:34:41.986303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 256/489] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:42.783461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:42.784066 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:42.791486 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:42.791954 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:42.792642 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:42.793370 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:42.793833 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:42.794927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:42.810496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 HTTP/1.1 Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:34:42.812667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:34:42.814233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '6264d236-8e5e-4e84-818f-10b9a8c54235'} Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:34:42.815057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:34:42.816479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:42.817779 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:34:42.817779 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a107e562-58a9-4de7-bedf-1963f9ccdef5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 404 len: 111 microversion: 2.1 time: 0.034471 Aug 10 12:34:42.817779 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 234/490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:42 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:34:42.823854 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1c102772-24eb-4658-be1b-6a179cba8d19 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '.version_select at 0x7fcb98059310>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:42.844018 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1c102772-24eb-4658-be1b-6a179cba8d19 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71050895" status: 202 len: 0 microversion: 2.1 time: 0.024715 Aug 10 12:34:42.844614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 257/491] 10.222.0.65 () {58 vars in 1215 bytes} [Wed Aug 10 12:34:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71050895 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:34:43.527563 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:43.528147 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:43.534131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:43.534608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:43.535034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:43.535714 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:43.536162 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:43.536579 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:43.657230 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lazy-loading 'services' on Instance uuid 7e6bf86e-2553-4f1c-8620-92c63510184a {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:34:43.768635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dd4e3b04-437a-4e79-b771-1a0dd7b117c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments/d651b075-70a7-48ee-8b35-acfbe2a0c10e" status: 202 len: 0 microversion: 2.1 time: 0.244783 Aug 10 12:34:43.769251 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 235/492] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:34:43 2022] DELETE /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments/d651b075-70a7-48ee-8b35-acfbe2a0c10e => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:34:43.777676 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:43.779986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:43.787271 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:43.787893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:43.788400 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:43.789038 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:43.789539 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:43.789969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:43.818897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-87f4fb74-a0d6-47b1-a7fd-873e21e0f75f tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Aug 10 12:34:43.819457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 258/493] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:34:43 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:44.831517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:44.833741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:44.839760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:44.840239 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:44.840667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:44.841370 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:44.841819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:44.842238 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:44.875659 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c0a6ad8a-2f22-4b28-be39-3b5c55ced535 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048716 Aug 10 12:34:44.876131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 236/494] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:34:44 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:45.887948 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:45.890641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:45.897155 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:45.897666 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:45.898105 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:45.898799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:45.899284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:45.899713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:45.927077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-08d74eda-9a82-4ba5-b272-213f68490a33 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043181 Aug 10 12:34:45.927607 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 259/495] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:34:45 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:34:45.987112 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:45.987604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:45.993890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:45.994368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:45.994796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:45.995472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:45.995925 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:45.996340 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:46.020793 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:34:46.092526 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1cbf5a9c-f2db-4f14-9e94-9ed3d851bc90 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 204 len: 0 microversion: 2.1 time: 0.108704 Aug 10 12:34:46.093294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 237/496] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:34:45 2022] DELETE /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:34:46.102264 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:46.102866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:46.109506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:46.109991 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:46.110427 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:46.111120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:46.111574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:46.111996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:46.237175 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:46.244565 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2bdfe132-05b8-40ad-8409-9530c842226c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1681 microversion: 2.1 time: 0.146548 Aug 10 12:34:46.245120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 260/497] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:46 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:47.266493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:47.267178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:47.273527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:47.274007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:47.274436 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:47.275118 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:47.275568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:47.275989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:47.406481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:47.414009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-38f28094-553d-4f7c-a964-a51ae3f1cc6b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1681 microversion: 2.1 time: 0.151595 Aug 10 12:34:47.414520 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 238/498] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:47 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:48.435799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:48.436573 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:48.443006 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:48.443657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:48.444155 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:48.444933 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:48.445424 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:48.445848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:48.655086 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:48.662957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e290f2d9-c912-47ec-a756-02bd42c951d5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1681 microversion: 2.1 time: 0.231408 Aug 10 12:34:48.663525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 261/499] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:48 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:49.200081 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-fa99b304-f924-4e1f-99e2-0022df1d3504 req-90edb72b-3b42-49a5-b4c3-1faf0e550e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e6bf86e-2553-4f1c-8620-92c63510184a", "name": "network-vif-deleted", "tag": "ee59973b-b76f-446a-a41a-885cc40ea7c3"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:49.210263 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa99b304-f924-4e1f-99e2-0022df1d3504 req-90edb72b-3b42-49a5-b4c3-1faf0e550e05 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:49.210954 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa99b304-f924-4e1f-99e2-0022df1d3504 req-90edb72b-3b42-49a5-b4c3-1faf0e550e05 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:49.211584 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa99b304-f924-4e1f-99e2-0022df1d3504 req-90edb72b-3b42-49a5-b4c3-1faf0e550e05 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:49.223438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-fa99b304-f924-4e1f-99e2-0022df1d3504 req-90edb72b-3b42-49a5-b4c3-1faf0e550e05 service nova] Creating event network-vif-deleted:ee59973b-b76f-446a-a41a-885cc40ea7c3 for instance 7e6bf86e-2553-4f1c-8620-92c63510184a on hv-cinder-85226 Aug 10 12:34:49.228319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-fa99b304-f924-4e1f-99e2-0022df1d3504 req-90edb72b-3b42-49a5-b4c3-1faf0e550e05 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Aug 10 12:34:49.229241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 239/500] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:34:49.684061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:49.684579 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:49.691249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:49.691965 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:49.692594 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:49.693527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:49.694130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:49.694701 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:49.726376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:49.726858 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:49.727317 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:49.728134 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lazy-loading 'fault' on Instance uuid 7e6bf86e-2553-4f1c-8620-92c63510184a {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:34:49.780749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:49.789661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3cefc841-47f4-4309-88c0-00fc64afa9fa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 200 len: 1331 microversion: 2.1 time: 0.109516 Aug 10 12:34:49.790535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 262/501] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:49 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:50.811203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:50.811886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:50.819173 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:50.819649 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:50.820077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:50.820757 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:50.821206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:50.821668 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:50.834444 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a HTTP/1.1 Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:34:50.836050 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:34:50.837507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '7e6bf86e-2553-4f1c-8620-92c63510184a'} Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:34:50.838282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:34:50.839635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:34:50.840838 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:34:50.840838 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-40194507-52fa-41bc-b3de-3586b3a10d8d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 404 len: 111 microversion: 2.1 time: 0.030336 Aug 10 12:34:50.840838 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 240/502] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:50 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:34:50.846230 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5c770d46-3159-473e-b77f-826a7de3a15c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '.version_select at 0x7fcb9808e280>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:50.864618 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5c770d46-3159-473e-b77f-826a7de3a15c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-207948603" status: 202 len: 0 microversion: 2.1 time: 0.022125 Aug 10 12:34:50.865097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 263/503] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 10 12:34:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-207948603 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:34:51.464209 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fe1e4cdf-403e-4ed0-a718-4b7543cbca01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: .version_select at 0x7fcb92e10e50>, body: {"keypair": {"name": "tempest-keypair-2006767297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD7rmFjaeAjDy9pm8/Z9S2xaSzwJ5vKXkQ8X2SJzTuvhJRoNHaYX62idxJUzMeUn/6B/yHP6B6Fw5GGaT7lued8E5dU5aH9m+x8NyuW+BOgskSueqTpOLpS0cP6gEqS7A=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:51.480294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-fe1e4cdf-403e-4ed0-a718-4b7543cbca01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for project 0bbb137a895941b1876eebfc56c28425. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:34:51.483990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-fe1e4cdf-403e-4ed0-a718-4b7543cbca01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for user 9b8e4aad09814f8299a334639e34d948 and project 0bbb137a895941b1876eebfc56c28425. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:34:51.504108 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fe1e4cdf-403e-4ed0-a718-4b7543cbca01 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043905 Aug 10 12:34:51.504887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 241/504] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:34:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:52.739599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1257873888", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69a0d312-b2de-4689-b0c5-62b84c9112b2"}], "security_groups": [{"name": "tempest-securitygroup--20126722"}], "key_name": "tempest-keypair-2006767297", "user_data": "}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:52.839874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] validate_networks() for [('69a0d312-b2de-4689-b0c5-62b84c9112b2', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:34:53.196726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:34:53.197215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:34:53.197960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:34:53.198378 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:34:53.198795 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:34:53.208011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:53.208495 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:53.208936 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:53.209708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:53.210167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:53.210596 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:53.227498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for project 0bbb137a895941b1876eebfc56c28425. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:34:53.231472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for user 9b8e4aad09814f8299a334639e34d948 and project 0bbb137a895941b1876eebfc56c28425. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:34:53.242371 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:34:53.244646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:34:53.289880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b0af5092-8dad-43f0-a5c1-85ae00877177 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.555584 Aug 10 12:34:53.290525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 264/505] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:34:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:34:53.301648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c5e1e675-e59c-4793-b7d2-fcb83de4c0ec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:53.302257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c5e1e675-e59c-4793-b7d2-fcb83de4c0ec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:53.357776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c5e1e675-e59c-4793-b7d2-fcb83de4c0ec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:53.364768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c5e1e675-e59c-4793-b7d2-fcb83de4c0ec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1242 microversion: 2.1 time: 0.067442 Aug 10 12:34:53.365346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 242/506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:53 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:54.387259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:54.387938 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:54.393903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:54.394383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:54.394815 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:54.395500 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:54.395948 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:54.396368 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:54.459860 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:54.467317 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-bf514918-e909-4cf1-992d-c1a71dcbac56 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1294 microversion: 2.1 time: 0.084451 Aug 10 12:34:54.467879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 265/507] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:54 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:55.487940 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:55.488541 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:55.494969 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:55.495455 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:55.495883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:55.496559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:55.497007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:55.497469 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:55.625624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:55.632980 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-27ad3391-5e32-482a-84e7-db0712bc171b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1366 microversion: 2.1 time: 0.148781 Aug 10 12:34:55.633568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 243/508] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:55 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:55.899967 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-d93df125-1a80-4d68-8034-6ff6db1025df req-ae1a2b08-8adc-4a44-b75d-5c888def8c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88", "tag": "eb383832-e054-468a-bbe7-6143a86ffefd"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:55.910867 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d93df125-1a80-4d68-8034-6ff6db1025df req-ae1a2b08-8adc-4a44-b75d-5c888def8c52 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:55.911434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d93df125-1a80-4d68-8034-6ff6db1025df req-ae1a2b08-8adc-4a44-b75d-5c888def8c52 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:55.912047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-d93df125-1a80-4d68-8034-6ff6db1025df req-ae1a2b08-8adc-4a44-b75d-5c888def8c52 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:55.925212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-d93df125-1a80-4d68-8034-6ff6db1025df req-ae1a2b08-8adc-4a44-b75d-5c888def8c52 service nova] Creating event network-changed:eb383832-e054-468a-bbe7-6143a86ffefd for instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 on hv-cinder-85226 Aug 10 12:34:55.930108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-d93df125-1a80-4d68-8034-6ff6db1025df req-ae1a2b08-8adc-4a44-b75d-5c888def8c52 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033968 Aug 10 12:34:55.930686 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 266/509] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:56.654269 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:56.654907 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:56.661539 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:56.662031 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:56.662467 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:56.663160 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:56.663620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:56.664045 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:56.796187 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:56.803478 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cb9db189-029c-4b13-8ae2-d667e03fe2aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1366 microversion: 2.1 time: 0.153215 Aug 10 12:34:56.804257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 244/510] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:56 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:57.824268 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:57.824970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:57.831906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:57.832402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:57.832838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:57.833554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:57.834015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:57.834439 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:58.034646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:58.041973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-252fc26f-dbb6-4b86-80c6-8881eb5dff85 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1366 microversion: 2.1 time: 0.222451 Aug 10 12:34:58.042531 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 267/511] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:57 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:59.063267 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:59.063872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:34:59.070184 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:59.070666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:59.071101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:59.071787 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:34:59.072241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:34:59.072666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:34:59.195852 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:34:59.203129 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-be155fea-2bf2-400a-8207-e9a4d65d19f1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1366 microversion: 2.1 time: 0.144273 Aug 10 12:34:59.203689 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 245/512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:34:59 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:00.223188 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:00.223808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:00.230155 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:00.230646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:00.231092 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:00.231799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:00.232256 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:00.232684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:00.302257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-92b6be28-5622-40fb-a45d-f0850263fde1 req-0615c3f6-1655-435e-9b8c-f189b43e6975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88", "name": "network-vif-plugged", "status": "completed", "tag": "eb383832-e054-468a-bbe7-6143a86ffefd"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:00.318423 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-92b6be28-5622-40fb-a45d-f0850263fde1 req-0615c3f6-1655-435e-9b8c-f189b43e6975 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:00.319112 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-92b6be28-5622-40fb-a45d-f0850263fde1 req-0615c3f6-1655-435e-9b8c-f189b43e6975 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:00.320132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-92b6be28-5622-40fb-a45d-f0850263fde1 req-0615c3f6-1655-435e-9b8c-f189b43e6975 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:00.334066 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-92b6be28-5622-40fb-a45d-f0850263fde1 req-0615c3f6-1655-435e-9b8c-f189b43e6975 service nova] Creating event network-vif-plugged:eb383832-e054-468a-bbe7-6143a86ffefd for instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 on hv-cinder-85226 Aug 10 12:35:00.339004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-92b6be28-5622-40fb-a45d-f0850263fde1 req-0615c3f6-1655-435e-9b8c-f189b43e6975 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040634 Aug 10 12:35:00.340113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 246/513] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:35:00.365732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:00.373350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9f6adae8-564d-4980-b284-f05d19407da4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1366 microversion: 2.1 time: 0.154225 Aug 10 12:35:00.374015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 268/514] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:00 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:01.395906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:01.396607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:01.402701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:01.403191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:01.403629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:01.404329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:01.404786 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:01.405244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:01.533558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:01.540841 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e0e1cf1f-0d1f-451d-8865-1ad3f40587f9 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1366 microversion: 2.1 time: 0.150227 Aug 10 12:35:01.541431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 247/515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:01 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:02.561869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:02.562519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:02.569076 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:02.569540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:02.569987 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:02.570697 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:02.571155 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:02.571582 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:02.718434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:02.727660 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f1d3bdb0-fc85-4317-9a63-8f7a01fd14c2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1366 microversion: 2.1 time: 0.169547 Aug 10 12:35:02.728279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 269/516] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:02 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:03.748912 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:03.749490 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:03.752479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:03.757815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:03.758298 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:03.758734 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:03.759428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:03.759890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:03.760313 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:03.886588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:03.894736 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b594db0d-dcb4-498e-9733-0300d95a2bff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1557 microversion: 2.1 time: 0.149772 Aug 10 12:35:03.895301 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 248/517] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:03 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:03.914990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:03.915491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:03.917502 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:03.918253 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=6 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:03.924889 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:03.925397 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:03.925838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:03.926521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:03.926972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:03.927391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:04.002747 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-80959fe7-b4f8-41a0-8b9d-e8580027bfbc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091577 Aug 10 12:35:04.003358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 270/518] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 10 12:35:03 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:05.147979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-85524278-3287-4591-ad45-4b0bcceddd25 req-8dfeebf1-e5d0-4d8d-a167-4f1a8440f699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88", "tag": "eb383832-e054-468a-bbe7-6143a86ffefd"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:05.157989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-85524278-3287-4591-ad45-4b0bcceddd25 req-8dfeebf1-e5d0-4d8d-a167-4f1a8440f699 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:05.158383 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-85524278-3287-4591-ad45-4b0bcceddd25 req-8dfeebf1-e5d0-4d8d-a167-4f1a8440f699 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:05.158878 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-85524278-3287-4591-ad45-4b0bcceddd25 req-8dfeebf1-e5d0-4d8d-a167-4f1a8440f699 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:05.169927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-85524278-3287-4591-ad45-4b0bcceddd25 req-8dfeebf1-e5d0-4d8d-a167-4f1a8440f699 service nova] Creating event network-changed:eb383832-e054-468a-bbe7-6143a86ffefd for instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 on hv-cinder-85226 Aug 10 12:35:05.175176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-85524278-3287-4591-ad45-4b0bcceddd25 req-8dfeebf1-e5d0-4d8d-a167-4f1a8440f699 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030892 Aug 10 12:35:05.176052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 249/519] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:12.093564 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:12.095856 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:12.098025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:12.103318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:12.103808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:12.104252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:12.104943 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:12.105451 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:12.105879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:12.110353 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=85 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:12.178365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5aebd6fa-5fa8-4606-ae39-050df24f1f16 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "POST /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/action" status: 202 len: 0 microversion: 2.1 time: 0.089125 Aug 10 12:35:12.179256 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 271/520] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:35:12 2022] POST /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:35:12.188489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:12.189182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:12.191126 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:12.197775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:12.198361 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:12.198896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:12.199663 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:12.200213 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:12.200738 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:12.204295 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:12.349292 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:12.357157 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8c61b6db-bf74-4b4a-b2f4-54aa4e6d4306 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1752 microversion: 2.1 time: 0.173579 Aug 10 12:35:12.357827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 250/521] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:12 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:13.380331 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:13.381146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:13.387759 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:13.388240 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:13.388673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:13.389395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:13.389847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:13.390292 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:13.532624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:13.540461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-85a2d590-150f-40b9-9982-af8cc3ba08c0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.165073 Aug 10 12:35:13.541017 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 272/522] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:13 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:14.561996 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:14.563179 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:14.569762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:14.570183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:14.570614 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:14.571292 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:14.571790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:14.572211 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:14.714963 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:14.723043 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-008172b0-4aac-4cbe-a51f-ad4860fb79c9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.164884 Aug 10 12:35:14.723600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 251/523] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:14 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:15.744257 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:15.744879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:15.751991 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:15.752481 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:15.752922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:15.753641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:15.754101 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:15.754532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:15.894881 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:15.902848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-48a6862c-a045-4105-b566-e40341790f5f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.162532 Aug 10 12:35:15.903402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 273/524] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:15 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:16.923582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:16.924205 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:16.930633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:16.931119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:16.931576 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:16.932268 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:16.932726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:16.933153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:17.072590 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:17.080885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-36a47c98-be05-4c1e-8ab5-79984efdabf0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.161171 Aug 10 12:35:17.081476 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 252/525] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:16 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:18.102841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:18.103515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:18.110615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:18.111097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:18.111528 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:18.112212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:18.112669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:18.113087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:18.211664 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e1d04b0-0c77-4f6c-ba39-80f53e210b24"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:18.214077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:18.220538 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:18.221017 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:18.221749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:18.222436 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:18.222886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:18.223304 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:18.257588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:18.266191 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3152b830-8fea-4e1a-b70a-7540b8340995 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.166829 Aug 10 12:35:18.266763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 274/526] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:18 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:18.500658 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bb99cba7-c40b-4841-8f6c-3876454913a8 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292755 Aug 10 12:35:18.501363 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 253/527] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:35:18 2022] POST /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:35:19.286803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:19.287396 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:19.293780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:19.294261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:19.294693 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:19.295382 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:19.295836 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:19.296285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:19.440345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:19.449425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-fae46840-22b8-4482-a5a9-529315f82d29 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.166379 Aug 10 12:35:19.450166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 275/528] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:19 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:20.470547 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:20.471230 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:20.477797 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:20.478293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:20.478733 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:20.479431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:20.479884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:20.480308 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:20.624412 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:20.633311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-395570ab-5b39-49c6-8330-f4f0d2db5540 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.166759 Aug 10 12:35:20.633311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 254/529] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:20 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:21.654732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:21.655372 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:21.661731 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:21.662210 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:21.662645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:21.663354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:21.663810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:21.664229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:21.805652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:21.813968 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0302c5dd-05ce-49c3-b304-091e9b63bad9 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.163069 Aug 10 12:35:21.814522 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 276/530] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:21 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:22.658381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:22.658880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:22.665497 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:22.665981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:22.666419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:22.667106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:22.667568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:22.667990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:22.695695 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-29fd9e3d-1d84-44d1-9493-3792b81e8d58 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments/62c841b0-ebc2-4d27-9401-d04db94c2993" status: 200 len: 194 microversion: 2.20 time: 0.041828 Aug 10 12:35:22.696260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 255/531] 10.222.0.65 () {60 vars in 1454 bytes} [Wed Aug 10 12:35:22 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments/62c841b0-ebc2-4d27-9401-d04db94c2993 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:35:22.762059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:22.762548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:22.769527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:22.770011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:22.770446 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:22.771194 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:22.771647 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:22.772070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:22.834769 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:22.835479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:22.841314 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:22.841799 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:22.842235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:22.842927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:22.843384 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:22.844395 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:22.899538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lazy-loading 'services' on Instance uuid b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:35:22.987625 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:22.996206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-56438bc1-5b09-49fe-b8f4-3b6aad073273 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.165091 Aug 10 12:35:23.009943 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 256/532] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:22 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:23.013723 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-01eb6c11-4057-4565-866b-51d9b30ed9de tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments/62c841b0-ebc2-4d27-9401-d04db94c2993" status: 202 len: 0 microversion: 2.20 time: 0.255387 Aug 10 12:35:23.014308 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 277/533] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 10 12:35:22 2022] DELETE /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments/62c841b0-ebc2-4d27-9401-d04db94c2993 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:35:23.023112 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:23.025394 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:23.032131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:23.032839 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:23.033331 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:23.034101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:23.034558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:23.034981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:23.064805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7b033742-4077-4097-9d0c-b3088b6e3e9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045584 Aug 10 12:35:23.065433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 257/534] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 10 12:35:23 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:35:24.018527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:24.019253 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:24.025336 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:24.025850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:24.026283 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:24.026971 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:24.027426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:24.027851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:24.077358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:24.079537 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:24.086017 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:24.086505 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:24.086938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:24.087624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:24.088074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:24.088493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:24.118220 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-480d2b1b-0837-465f-9936-ee79478694da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044895 Aug 10 12:35:24.118779 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 258/535] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 10 12:35:24 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:35:24.168179 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:24.176568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a1b4ba79-795a-4508-a9c3-d2d677505a2b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.162665 Aug 10 12:35:24.177132 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 278/536] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:24 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:25.131128 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:25.133157 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:25.139298 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:25.139775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:25.140200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:25.140881 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:25.141356 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:25.141777 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:25.169631 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ea1fcde7-3d02-4b5c-b9ac-da887f9a41ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043168 Aug 10 12:35:25.170179 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 259/537] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 10 12:35:25 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:35:25.197060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:25.197701 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:25.205528 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:25.206029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:25.206839 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:25.207550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:25.208015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:25.209120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:25.361374 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:25.369300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-94496d9e-0636-47d9-af4a-3746b3e341d3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.176102 Aug 10 12:35:25.369867 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 279/538] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:25 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:26.015934 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:26.018138 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:26.023970 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:26.024448 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:26.024885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:26.025604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:26.026061 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:26.026484 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:26.049391 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lazy-loading 'flavor' on Instance uuid 406145f8-c18f-42a6-ad69-122776fcde13 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:35:26.182430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:26.184732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:26.191713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:26.192198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:26.192661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:26.193591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:26.194047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:26.194478 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:26.207317 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-444e2a8b-9462-4cbb-9b46-e84ddaf9781d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/action" status: 200 len: 32 microversion: 2.1 time: 0.195873 Aug 10 12:35:26.207946 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 260/539] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:35:26 2022] POST /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:35:26.217931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:26.218648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:26.225054 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6e839be6-623f-40b0-9da9-ad6e79e11d34 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046583 Aug 10 12:35:26.229615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 280/540] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 10 12:35:26 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:35:26.229766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:26.229766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:26.229766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:26.229766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:26.230120 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:26.230120 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:26.373956 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:26.382325 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2421f292-613c-44bd-9cd5-cba58309623f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.168460 Aug 10 12:35:26.382896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 261/541] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:26 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:26.391458 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:26.392074 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:26.398656 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:26.399212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:26.399652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:26.400344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:26.400802 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:26.401223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:26.645922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:26.654277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-38e5213a-e3a8-41ac-b5ce-ad549fbcb796 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.266807 Aug 10 12:35:26.654849 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 281/542] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:26 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:27.237897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:27.240156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:27.246565 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.247041 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.247472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.248160 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.248616 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.249039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.276998 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0ff5b0da-212d-4329-ac8e-9d5a1494a782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043586 Aug 10 12:35:27.277503 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 262/543] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 10 12:35:27 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:27.337023 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:27.337536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:27.343727 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.344203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.344657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.345358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.345808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.346229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.370755 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:35:27.402954 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:27.403708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:27.410531 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.411094 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.411612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.412299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.412749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.413166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.429260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:27.454687 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7dacaa38-2867-4ccf-b1dd-9da80d02f530 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 204 len: 0 microversion: 2.20 time: 0.121049 Aug 10 12:35:27.458520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 282/544] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 10 12:35:27 2022] DELETE /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 12:35:27.463908 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:27.464603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:27.470540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.471021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.471708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.472406 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.472865 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.473298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.556374 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:27.565001 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c0ebe89a-8e0d-4630-bd9d-fe36a3394e73 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.165799 Aug 10 12:35:27.566028 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 263/545] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:27 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:27.604924 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:27.613425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:27.614931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:27.616083 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-20560a0b-9d79-4f11-8f3c-dc063ffc166f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.156349 Aug 10 12:35:27.616638 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 283/546] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:27 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:27.676315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:27.676929 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:27.682803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.683288 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.683728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.684785 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:27.685253 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:27.685706 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:27.822873 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:27.830789 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dd73fc4c-726e-4b8a-8a2d-bcf43d355059 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.158996 Aug 10 12:35:27.831353 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 264/547] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:27 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:28.586690 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:28.587324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:28.593764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:28.594252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:28.594700 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:28.595378 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:28.595833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:28.596507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:28.611173 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:28.638309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:28.639004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:28.646101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:28.646593 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:28.647028 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:28.647722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:28.648175 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:28.648598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:28.730775 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:28.739167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8ff591e9-1f99-4c22-a3a8-d950cdd9fe84 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.156257 Aug 10 12:35:28.739739 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 284/548] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:28 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:28.779906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:28.787877 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:28.789408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:28.790570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9e29a0e0-2205-499f-9738-01a733443815 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.156127 Aug 10 12:35:28.791114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 265/549] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:28 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:35:28.850908 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:28.851443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:28.857879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:28.858364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:28.858797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:28.859517 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:28.859966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:28.860491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:29.003959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:29.011789 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3d30bddb-c7d0-42d6-9a4c-f936080cd090 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.164693 Aug 10 12:35:29.012352 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 285/550] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:28 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:29.760675 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:29.761298 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:29.768737 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:29.769217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:29.769669 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:29.770363 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:29.770815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:29.771236 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:29.813655 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:29.814997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:29.821094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:29.821604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:29.822032 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:29.822973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:29.823426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:29.823846 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:29.901242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:29.909808 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9fd741db-7b83-4c96-acbe-72e5dab74dab tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.152945 Aug 10 12:35:29.910373 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 266/551] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:29 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:30.032370 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:30.033515 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:30.039459 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:30.039951 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:30.040385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:30.041309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:30.041556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:30.041981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:30.051484 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:30.060184 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:30.061726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:30.062879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4eb7d652-5138-4647-8f5a-97d93984352c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1721 microversion: 2.20 time: 0.253106 Aug 10 12:35:30.064213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 286/552] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:29 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:35:30.089410 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:30.090680 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:30.096895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:30.097408 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:30.097845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:30.098537 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:30.098984 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:30.099402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:30.191224 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lazy-loading 'services' on Instance uuid 67832a65-635c-45ac-830c-7ae989a1fea6 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:35:30.197094 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:30.207081 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-80bea6d1-3bd9-46b0-9bde-b50e36bfefa2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1757 microversion: 2.1 time: 0.177862 Aug 10 12:35:30.207838 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 267/553] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:30 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:30.268595 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f76d4ed9-99bd-4739-b7a9-177badb91af5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/os-volume_attachments/8df0a3a5-13e7-470b-a046-29f1cd451082" status: 202 len: 0 microversion: 2.1 time: 0.182919 Aug 10 12:35:30.272276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 287/554] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:35:30 2022] DELETE /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/os-volume_attachments/8df0a3a5-13e7-470b-a046-29f1cd451082 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:35:30.755306 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-43e0db40-ec80-4acd-91b7-626f0711edf6 req-559ecc62-3e84-466c-baba-2db4d4cfe1bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2", "name": "network-vif-deleted", "tag": "dd060781-b144-4d67-99d5-c6d10616e60b"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:30.768999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-43e0db40-ec80-4acd-91b7-626f0711edf6 req-559ecc62-3e84-466c-baba-2db4d4cfe1bc service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:30.770262 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-43e0db40-ec80-4acd-91b7-626f0711edf6 req-559ecc62-3e84-466c-baba-2db4d4cfe1bc service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:30.770708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-43e0db40-ec80-4acd-91b7-626f0711edf6 req-559ecc62-3e84-466c-baba-2db4d4cfe1bc service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:30.783431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-43e0db40-ec80-4acd-91b7-626f0711edf6 req-559ecc62-3e84-466c-baba-2db4d4cfe1bc service nova] Creating event network-vif-deleted:dd060781-b144-4d67-99d5-c6d10616e60b for instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 on hv-cinder-85226 Aug 10 12:35:30.790750 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-43e0db40-ec80-4acd-91b7-626f0711edf6 req-559ecc62-3e84-466c-baba-2db4d4cfe1bc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038724 Aug 10 12:35:30.795667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 268/555] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:30.931980 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:30.933317 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:30.946913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:30.947431 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:30.947872 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:30.948584 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:30.949042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:30.949492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:31.086171 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:31.086995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:31.091544 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:31.093141 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:31.093814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:31.094255 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:31.094945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:31.096093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:31.096905 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:31.100371 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8d984b81-00df-42f2-9b32-cf12dae1b36b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.173174 Aug 10 12:35:31.101197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 288/556] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:30 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:31.130160 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:31.130567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:31.131005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:31.131479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lazy-loading 'fault' on Instance uuid b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:35:31.171766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:31.180013 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:31.181551 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:31.182695 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f18b642b-44aa-4173-9c02-77444d660f5a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 200 len: 1371 microversion: 2.20 time: 0.100768 Aug 10 12:35:31.183251 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 269/557] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:31 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:35:31.229436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:31.230080 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:31.236494 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:31.236986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:31.237453 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:31.238149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:31.238607 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:31.239036 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:31.386717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:31.395103 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1d453aee-a4c1-4413-8dec-80062266190e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1760 microversion: 2.1 time: 0.169533 Aug 10 12:35:31.395666 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 289/558] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:31 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:32.121566 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:32.122202 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:32.128429 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:32.128924 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:32.129387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:32.130090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:32.130549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:32.130981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:32.206023 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:32.206641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:32.212835 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:32.213484 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:32.213938 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:32.214648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:32.215109 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:32.215540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:32.229729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] HTTP exception thrown: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Request method failure captured: Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 HTTP/1.1 Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UTRJO1ms9qeirRevR4Q4K1dg1pUC5CVO8ew8WClAhTSvt90C6ioBMrJmcb2G_uJLVH0yf2VOy-BMwGRIBYXTQDl9xMQ5qWa3h1r1p5GG0y2o4Qz7GcaR5oA8zP9jT41bK7OpZmgUzm8zCrtJuAr0ULJF1XqUoRjjhTX5kjvZMij9U Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:35:32.231415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}] Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: a78bd1aed509474b965592c478cb1c0c Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:35:32.233130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2'} Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:35:32.234110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:35:32.235318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:35:32.237030 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Returning 404 to user: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:35:32.237030 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-16cd3782-bcd4-4fd4-8cce-27bc8e0bba6c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 404 len: 111 microversion: 2.20 time: 0.030655 Aug 10 12:35:32.237030 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 290/559] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:32 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 12:35:32.242002 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-897ca188-c232-4110-9bef-02dd3e606999 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '.version_select at 0x7fcb9806c700>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:32.262162 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:32.262708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-897ca188-c232-4110-9bef-02dd3e606999 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873617873" status: 204 len: 0 microversion: 2.20 time: 0.023701 Aug 10 12:35:32.263293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 291/560] 10.222.0.65 () {60 vars in 1262 bytes} [Wed Aug 10 12:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1873617873 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 12:35:32.270244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b6dc6646-159b-4c29-bccd-5d98f212c49f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.152472 Aug 10 12:35:32.270795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 270/561] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:32 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:32.448430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1e116db0-25fb-4a52-83e1-cd928826a9b6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:32.456393 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1e116db0-25fb-4a52-83e1-cd928826a9b6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:32.456822 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1e116db0-25fb-4a52-83e1-cd928826a9b6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:32.457322 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1e116db0-25fb-4a52-83e1-cd928826a9b6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:32.518460 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1e116db0-25fb-4a52-83e1-cd928826a9b6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Going to try to stop instance {{(pid=118379) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 12:35:32.563396 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1e116db0-25fb-4a52-83e1-cd928826a9b6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/action" status: 202 len: 0 microversion: 2.1 time: 0.119704 Aug 10 12:35:32.564260 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 292/562] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:35:32 2022] POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:35:32.572408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:32.573388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:32.580283 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:32.581047 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:32.581747 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:32.582526 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:32.583058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:32.583587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:32.716273 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:32.724916 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f1ae51e9-db8c-4ec8-9f1e-63b1e39e46b3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.156440 Aug 10 12:35:32.725608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 271/563] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:32 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:32.927878 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9a04021a-dadf-43a5-82bc-d56be95d9020 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'create', calling method: .version_select at 0x7fcb9806c040>, body: {"keypair": {"name": "tempest-keypair-1185975824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeo+sP919QG8K5YhOdS0ZjVdFn5lcVyNi9xj5MqUVWm25Q9pCYB61DET1wE5r7F6RAys7TF7jY1vtht4ljXrF6L6BRA8CMXLBci4unFyCuh9w13zDd/mLB6D/y/9bTUvw=="}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:32.943068 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-9a04021a-dadf-43a5-82bc-d56be95d9020 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Getting quotas for project 4eb5c9a17d7341d3a3dd60ef2b7a381d. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:35:32.946717 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-9a04021a-dadf-43a5-82bc-d56be95d9020 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Getting quotas for user a78bd1aed509474b965592c478cb1c0c and project 4eb5c9a17d7341d3a3dd60ef2b7a381d. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:35:32.968097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9a04021a-dadf-43a5-82bc-d56be95d9020 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044448 Aug 10 12:35:32.968608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 293/564] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 10 12:35:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 12:35:33.291819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:33.292529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:33.300701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:33.301307 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:33.301796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:33.302752 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:33.303277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:33.303706 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:33.442455 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:33.450240 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3efbf8da-10b5-40b4-8f64-4fbf0253c020 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.162374 Aug 10 12:35:33.450795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 272/565] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:33 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:33.746268 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:33.747586 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:33.756139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:33.757078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:33.757857 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:33.758860 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:33.760221 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:33.761120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:34.183338 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:34.190668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-48c492f5-bd51-4f27-819c-2e60b2453471 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.448286 Aug 10 12:35:34.191227 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 294/566] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:33 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:34.471137 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:34.472136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:34.478408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:34.478886 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:34.479317 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:34.480002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:34.480452 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:34.480875 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:34.536523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-853244334", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9747c644-617a-4b31-a63b-39dd1a5c7b9c"}], "security_groups": [{"name": "tempest-securitygroup--1183844292"}], "key_name": "tempest-keypair-1185975824", "user_data": "}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:34.613734 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:34.621477 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a36369ec-6b69-49f3-a711-ef5d8eb52fbf tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.154151 Aug 10 12:35:34.622046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 273/567] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:34 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:34.639762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] validate_networks() for [('9747c644-617a-4b31-a63b-39dd1a5c7b9c', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:35:35.007462 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:35:35.008061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:35:35.008382 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:35:35.008813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:35:35.009227 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:35:35.017995 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:35.018476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:35.018916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:35.019641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:35.020096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:35.020520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:35.036652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Getting quotas for project 4eb5c9a17d7341d3a3dd60ef2b7a381d. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:35:35.040571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Getting quotas for user a78bd1aed509474b965592c478cb1c0c and project 4eb5c9a17d7341d3a3dd60ef2b7a381d. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:35:35.051777 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:35:35.054041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:35:35.101684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-50412ec3-3f95-43eb-8ea0-1b5e4a9f9f51 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.569443 Aug 10 12:35:35.102347 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 295/568] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 10 12:35:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 10 12:35:35.113637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7f552f4f-c476-4d64-adfb-932145cb1873 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:35.114254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7f552f4f-c476-4d64-adfb-932145cb1873 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:35.170989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f552f4f-c476-4d64-adfb-932145cb1873 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:35.178808 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f552f4f-c476-4d64-adfb-932145cb1873 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:35.180324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f552f4f-c476-4d64-adfb-932145cb1873 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:35.181461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7f552f4f-c476-4d64-adfb-932145cb1873 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1281 microversion: 2.20 time: 0.072317 Aug 10 12:35:35.182005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 274/569] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:35 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:35.211212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:35.211848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:35.219156 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:35.219659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:35.220628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:35.221866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:35.222329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:35.222789 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:35.358189 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:35.366971 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c85dd159-a385-4435-8244-0592faedca69 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.159748 Aug 10 12:35:35.367891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 296/570] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:35 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:35.644517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:35.645106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:35.654184 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:35.654664 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:35.655092 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:35.655781 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:35.656241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:35.656665 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:35.787675 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:35.796236 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-20eeeaab-067b-4ac2-a331-cf3a2822df49 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.156711 Aug 10 12:35:35.796792 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 275/571] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:35 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:36.202639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:36.203257 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:36.210873 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:36.211366 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:36.211994 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:36.212705 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:36.213171 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:36.213628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:36.308114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:36.317038 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:36.318579 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:36.319685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-19acba8d-f1e8-4fb7-b3e3-592476249d1d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1341 microversion: 2.20 time: 0.120975 Aug 10 12:35:36.320239 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 297/572] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:36 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1341 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:35:36.388091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:36.388701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:36.394683 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:36.395167 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:36.395600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:36.396283 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:36.396738 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:36.397159 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:36.526843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:36.534247 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dd96f851-b965-4850-8d15-7e37e464e13c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.150222 Aug 10 12:35:36.534806 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 276/573] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:36 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:36.817966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:36.818656 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:36.825538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:36.826030 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:36.826474 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:36.827174 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:36.827632 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:36.828061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:37.040218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:37.048213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-eec32aec-a18f-48a1-a2ef-6b4c5ffefd8d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.234208 Aug 10 12:35:37.048765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 298/574] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:36 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:37.342816 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:37.343426 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:37.350898 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:37.351539 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:37.352087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:37.352879 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:37.353466 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:37.354018 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:37.486644 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:37.494639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:37.496080 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:37.497173 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8020bbf8-0e75-4ce9-bc1e-b860012d1d26 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1407 microversion: 2.20 time: 0.158375 Aug 10 12:35:37.497753 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 277/575] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:37 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:37.555297 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:37.555932 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:37.562277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:37.562756 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:37.563190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:37.564402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:37.564859 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:37.565294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:37.788809 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:37.796452 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-30a95c7a-8369-4ea2-9578-a5045da4697e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.245029 Aug 10 12:35:37.797092 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 299/576] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:37 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:37.902693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-9da310f4-a2ee-4ae6-ad70-c366761f4e72 req-d9e0120e-afea-4826-9df2-ba6442298302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abef27e9-175c-4101-80ee-6da94e239088", "tag": "40caaca6-10a7-43c8-8003-49d7c19f965f"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:37.913610 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-9da310f4-a2ee-4ae6-ad70-c366761f4e72 req-d9e0120e-afea-4826-9df2-ba6442298302 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:37.914389 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-9da310f4-a2ee-4ae6-ad70-c366761f4e72 req-d9e0120e-afea-4826-9df2-ba6442298302 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:37.915122 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-9da310f4-a2ee-4ae6-ad70-c366761f4e72 req-d9e0120e-afea-4826-9df2-ba6442298302 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:37.930988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-9da310f4-a2ee-4ae6-ad70-c366761f4e72 req-d9e0120e-afea-4826-9df2-ba6442298302 service nova] Creating event network-changed:40caaca6-10a7-43c8-8003-49d7c19f965f for instance abef27e9-175c-4101-80ee-6da94e239088 on hv-cinder-85226 Aug 10 12:35:37.936449 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-9da310f4-a2ee-4ae6-ad70-c366761f4e72 req-d9e0120e-afea-4826-9df2-ba6442298302 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038310 Aug 10 12:35:37.937257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 278/577] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:35:38.070419 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:38.071402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:38.077840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:38.078324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:38.078762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:38.079457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:38.079907 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:38.080380 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:38.283879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:38.291753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f7fc28f2-4a02-4f34-8904-dbf681232c10 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.225668 Aug 10 12:35:38.292329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 300/578] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:38 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:38.521589 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:38.522278 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:38.528239 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:38.528715 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:38.529221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:38.529922 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:38.530412 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:38.530900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:38.658214 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:38.666142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:38.667675 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:38.668781 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-55877437-e44f-49d4-9afa-35fac5c2242c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1407 microversion: 2.20 time: 0.152705 Aug 10 12:35:38.669353 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 279/579] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:38 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:38.817778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:38.818299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:38.824560 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:38.825041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:38.825515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:38.826202 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:38.826656 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:38.827077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:38.951568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:38.959561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5187504c-74a6-4284-a790-00206d39bf26 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.145627 Aug 10 12:35:38.960121 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 301/580] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:38 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:39.313370 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:39.314493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:39.320346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:39.320825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:39.321256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:39.321962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:39.322416 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:39.322839 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:39.450401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:39.458447 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-090d825e-efb4-4c6b-89ac-6a07c90e5f6e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.148983 Aug 10 12:35:39.459007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 280/581] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:39 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:39.690598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:39.691896 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:39.697840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:39.698324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:39.698759 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:39.699446 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:39.699901 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:39.700363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:39.890383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:39.892657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:39.899527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:39.901032 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:39.902167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-24e74313-9aa2-484c-b1f2-b5729f436d6e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1407 microversion: 2.20 time: 0.215538 Aug 10 12:35:39.902710 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 302/582] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:39 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:39.981499 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:39.982113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:39.988633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:39.989119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:39.989585 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:39.990281 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:39.990734 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:39.991186 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:40.121735 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:40.128990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-13ecbede-c7ed-4b84-ab7c-ae57b6beb105 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.151673 Aug 10 12:35:40.129578 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 281/583] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:39 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:40.479023 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:40.479747 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:40.487002 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:40.487574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:40.488006 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:40.488731 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:40.489186 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:40.489657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:40.622413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:40.630955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-451f39c1-4d1c-43ed-97a1-8ab5ea58cdaa tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.155717 Aug 10 12:35:40.631561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 303/584] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:40 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:40.924465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:40.925073 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:40.931069 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:40.931570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:40.932002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:40.932677 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:40.933155 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:40.933673 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:40.936277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:41.150838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:41.151437 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:41.153956 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:41.159972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:41.160468 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:41.160904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:41.161649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:41.162103 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:41.162525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:41.269660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:41.277588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:41.279164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:41.280331 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-589cdfac-75b1-490e-aedd-7cc5ba697b9d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1407 microversion: 2.20 time: 0.360290 Aug 10 12:35:41.280966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 282/585] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:40 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:41.296272 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:41.303806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-834fd5dd-2e14-4d09-a11e-81b4c897b951 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.156966 Aug 10 12:35:41.304369 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 304/586] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:41 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:41.651841 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:41.652492 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:41.658384 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:41.658864 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:41.659292 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:41.659981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:41.660416 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:41.660837 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:41.785872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:41.793564 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-93400134-2379-4b3a-9577-b58c044a9a88 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.145540 Aug 10 12:35:41.794116 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 283/587] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:41 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:42.302311 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:42.302911 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:42.309219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:42.309724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:42.310156 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:42.310840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:42.311287 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:42.311710 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:42.325734 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:42.326337 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:42.328589 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=72 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:42.335047 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:42.335164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:42.335527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:42.336216 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:42.336666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:42.337113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:42.451595 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:42.476862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:42.476862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:42.476862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-91c8298e-c600-40b6-8296-bd1b5b15d455 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1407 microversion: 2.20 time: 0.169113 Aug 10 12:35:42.477212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 305/588] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:42 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:42.490482 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:42.498112 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-be57bf25-f86f-441e-ba3c-75096c8c179b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1678 microversion: 2.1 time: 0.176124 Aug 10 12:35:42.498863 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 284/589] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:42 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:42.573421 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-c3dfb616-e90a-48f2-9be5-4e433a7d379e req-3dbb8a84-bc57-4963-a1fb-09f04970b0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abef27e9-175c-4101-80ee-6da94e239088", "name": "network-vif-plugged", "status": "completed", "tag": "40caaca6-10a7-43c8-8003-49d7c19f965f"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:42.584055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-c3dfb616-e90a-48f2-9be5-4e433a7d379e req-3dbb8a84-bc57-4963-a1fb-09f04970b0fb service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:42.584588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-c3dfb616-e90a-48f2-9be5-4e433a7d379e req-3dbb8a84-bc57-4963-a1fb-09f04970b0fb service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:42.584974 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-c3dfb616-e90a-48f2-9be5-4e433a7d379e req-3dbb8a84-bc57-4963-a1fb-09f04970b0fb service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:42.596961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-c3dfb616-e90a-48f2-9be5-4e433a7d379e req-3dbb8a84-bc57-4963-a1fb-09f04970b0fb service nova] Creating event network-vif-plugged:40caaca6-10a7-43c8-8003-49d7c19f965f for instance abef27e9-175c-4101-80ee-6da94e239088 on hv-cinder-85226 Aug 10 12:35:42.601910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-c3dfb616-e90a-48f2-9be5-4e433a7d379e req-3dbb8a84-bc57-4963-a1fb-09f04970b0fb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032172 Aug 10 12:35:42.602495 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 306/590] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:42.814973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:42.815626 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:42.821527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:42.822036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:42.822461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:42.823169 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:42.823621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:42.824039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:42.948461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:42.956815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b61762ec-0518-4f95-9c00-d81d5d0727a7 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.146225 Aug 10 12:35:42.957385 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 285/591] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:42 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:43.494729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:43.495415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:43.502050 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.502531 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.502966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:43.503658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.504109 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.504534 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:43.519131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:43.519744 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:43.526065 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.526547 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.526980 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:43.527665 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.528122 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.528539 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:43.639671 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:43.647615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:43.649116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:43.650284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-664261f6-66af-4663-bcf7-d5a115d3a124 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1407 microversion: 2.20 time: 0.160310 Aug 10 12:35:43.650841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 307/592] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:43 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:35:43.660478 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:43.667890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9cd249fc-d515-4276-b2a4-8b7254fb39c9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1655 microversion: 2.1 time: 0.152549 Aug 10 12:35:43.668459 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 286/593] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:43 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:43.688099 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8595430c-077f-4054-8119-73dd4ac17c98 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:43.694037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8595430c-077f-4054-8119-73dd4ac17c98 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.694520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8595430c-077f-4054-8119-73dd4ac17c98 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.694954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8595430c-077f-4054-8119-73dd4ac17c98 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:43.717762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8595430c-077f-4054-8119-73dd4ac17c98 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Going to try to start instance {{(pid=118379) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 12:35:43.757830 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8595430c-077f-4054-8119-73dd4ac17c98 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/action" status: 202 len: 0 microversion: 2.1 time: 0.073164 Aug 10 12:35:43.758351 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 308/594] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:35:43 2022] POST /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:35:43.766232 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:43.767414 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:43.773231 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.773746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.774178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:43.774863 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.775327 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.775750 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:43.904801 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:43.912887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-431b91a1-5079-4152-8f7f-146fbc373910 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1664 microversion: 2.1 time: 0.150426 Aug 10 12:35:43.913472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 287/595] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:43 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:43.977770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:43.978492 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:43.984491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.984971 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.985429 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:43.986111 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:43.986561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:43.986980 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:44.114014 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:44.121734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cdeeec30-5e84-4e61-9a55-6605bfb3d852 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.148166 Aug 10 12:35:44.122294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 309/596] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:43 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:44.672357 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:44.673499 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:44.679823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:44.680300 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:44.680728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:44.681433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:44.681882 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:44.682301 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:44.807315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:44.815616 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:44.817448 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:44.818540 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-aea25cc3-5feb-45d3-9726-c2d839bb8b20 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1407 microversion: 2.20 time: 0.150057 Aug 10 12:35:44.819096 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 288/597] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:44 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:35:44.933887 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:44.934478 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:44.940787 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:44.941286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:44.941719 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:44.942401 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:44.942849 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:44.943271 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:45.027875 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:45.046789 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=10 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:45.130284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:45.138372 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-313c167e-46e7-40f9-9293-84fb602d49ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1664 microversion: 2.1 time: 0.208177 Aug 10 12:35:45.143343 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:45.143949 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:45.147473 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 310/598] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:44 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1664 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:45.151651 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:45.151872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:45.152408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:45.153208 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:45.153769 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:45.154267 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:45.176815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:45.289803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:45.298961 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c51bac1d-d1cd-498a-a71b-81f16550e257 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.159325 Aug 10 12:35:45.299573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 289/599] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:45 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:35:45.840826 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:45.841878 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:45.848149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:45.848629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:45.849055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:45.849769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:45.850214 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:45.850630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:45.978360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:45.986645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:45.988148 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:45.989295 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ed371660-d6dd-42cb-a375-2d6830604649 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1597 microversion: 2.20 time: 0.152616 Aug 10 12:35:45.989844 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 311/600] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:35:45 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:46.011694 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:46.012211 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:46.018582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:46.019067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:46.019508 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:46.020196 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:46.020653 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:46.021076 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:46.095818 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-575be03c-ce4c-4fcb-b022-1297a5006129 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088026 Aug 10 12:35:46.096661 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 290/601] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 10 12:35:46 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:35:46.167950 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:46.168554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:46.175019 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:46.175501 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:46.175932 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:46.176623 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:46.177104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:46.177552 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:46.304076 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:46.311639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-13f57d19-9b51-444a-a0f8-c71bef3544ce tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1664 microversion: 2.1 time: 0.147475 Aug 10 12:35:46.312208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 312/602] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:46 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:46.320287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:46.320963 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:46.326854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:46.327339 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:46.327776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:46.328464 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:46.328925 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:46.329416 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:46.578364 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:46.587576 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-45ade799-1355-4310-8cff-c8b7c5fb3504 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.270990 Aug 10 12:35:46.588149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 291/603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:46 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:47.084944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-2ab038c8-3c7d-4c0e-a86c-1d01ffd0b32d req-ebccb886-4d5d-44de-84f9-8772a23cdd2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abef27e9-175c-4101-80ee-6da94e239088", "tag": "40caaca6-10a7-43c8-8003-49d7c19f965f"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:47.095557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2ab038c8-3c7d-4c0e-a86c-1d01ffd0b32d req-ebccb886-4d5d-44de-84f9-8772a23cdd2d service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:47.096119 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2ab038c8-3c7d-4c0e-a86c-1d01ffd0b32d req-ebccb886-4d5d-44de-84f9-8772a23cdd2d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:47.096925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2ab038c8-3c7d-4c0e-a86c-1d01ffd0b32d req-ebccb886-4d5d-44de-84f9-8772a23cdd2d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:47.108057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-2ab038c8-3c7d-4c0e-a86c-1d01ffd0b32d req-ebccb886-4d5d-44de-84f9-8772a23cdd2d service nova] Creating event network-changed:40caaca6-10a7-43c8-8003-49d7c19f965f for instance abef27e9-175c-4101-80ee-6da94e239088 on hv-cinder-85226 Aug 10 12:35:47.113192 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-2ab038c8-3c7d-4c0e-a86c-1d01ffd0b32d req-ebccb886-4d5d-44de-84f9-8772a23cdd2d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031916 Aug 10 12:35:47.113792 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 313/604] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:47.334213 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:47.335797 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:47.342546 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:47.343032 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:47.343659 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:47.344360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:47.345146 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:47.346103 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:47.485943 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:47.493516 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-34d16422-9cd8-433d-befa-eae614beba7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1668 microversion: 2.1 time: 0.163173 Aug 10 12:35:47.494083 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 292/605] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:47 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:47.610272 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:47.611604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:47.617681 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:47.618157 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:47.618590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:47.619273 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:47.619729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:47.620149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:47.752029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:47.760109 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2a10cf8a-9b75-430d-9a5d-00f88f893f78 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.154080 Aug 10 12:35:47.760915 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 314/606] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:47 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:48.781796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:48.782438 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:48.788542 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:48.789021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:48.789481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:48.790181 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:48.790684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:48.791105 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:48.929677 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:48.937714 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a047a5fa-436b-4a92-828d-edb390231307 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.160066 Aug 10 12:35:48.938271 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 293/607] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:48 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:49.959838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:49.960449 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:49.966875 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:49.967415 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:49.967868 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:49.968565 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:49.969024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:49.969486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:50.097467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:50.105277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-19b16baf-9bbd-44dd-8c0c-e81ed4fb53ff tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1733 microversion: 2.1 time: 0.149303 Aug 10 12:35:50.105844 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 315/608] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:49 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:50.845600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:50.846419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:50.852748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:50.853182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:50.853682 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:50.854382 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:50.854842 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:50.855270 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:50.878177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-140cb364-5bc0-4e79-834c-222d4479b29e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/ips" status: 200 len: 150 microversion: 2.1 time: 0.036933 Aug 10 12:35:50.878741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 294/609] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:35:50 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:51.126189 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:51.127353 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:51.134259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:51.134927 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:51.135631 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:51.136497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:51.137103 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:51.137723 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:51.272148 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:51.280025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e8c0e6ca-ab9f-49d0-a7aa-73bfe52f6add tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1713 microversion: 2.1 time: 0.157669 Aug 10 12:35:51.280586 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 316/610] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:51 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:51.340420 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:51.340948 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:51.347739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:51.348222 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:51.348662 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:51.349378 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:51.349836 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:51.350266 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:51.428099 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] HTTP exception thrown: Cannot 'detach_volume' instance 406145f8-c18f-42a6-ad69-122776fcde13 while it is in vm_state rescued Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Request method failure captured: Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments/7e1d04b0-0c77-4f6c-ba39-80f53e210b24 HTTP/1.1 Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UVCZy5cePM0_ipeKQGog--zdcGvp9RYAIh0ETNO7C_3X7o1pwdTynr0ywJx0KC7nZ4LUrhMqxiuprvTLwbCri2KCNWuuLilVY1_i-Mk6T1KxaJyBHdOkYA6xYKYWVs9Sp5sN4E6C3M9XINhC3x5-uhV528eibATDOc31y-O2lsFbU Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:35:51.429867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2301f937213e47c29686be4e8601ac32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2301f937213e47c29686be4e8601ac32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}] Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 2aa6d6d56f9f4618ae3883c9beb2e77b Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:35:51.431234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Cannot 'detach_volume' instance 406145f8-c18f-42a6-ad69-122776fcde13 while it is in vm_state rescued Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'server_id': '406145f8-c18f-42a6-ad69-122776fcde13', 'id': '7e1d04b0-0c77-4f6c-ba39-80f53e210b24'} Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 406145f8-c18f-42a6-ad69-122776fcde13 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:35:51.431986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 406145f8-c18f-42a6-ad69-122776fcde13 while it is in vm_state rescued Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 406145f8-c18f-42a6-ad69-122776fcde13 while it is in vm_state rescued Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:35:51.433612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Returning 409 to user: Cannot 'detach_volume' instance 406145f8-c18f-42a6-ad69-122776fcde13 while it is in vm_state rescued {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:35:51.434774 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-086cd7db-3554-4bf4-80d3-02c9c78be399 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "DELETE /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments/7e1d04b0-0c77-4f6c-ba39-80f53e210b24" status: 409 len: 152 microversion: 2.1 time: 0.094837 Aug 10 12:35:51.434774 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 295/611] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:35:51 2022] DELETE /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments/7e1d04b0-0c77-4f6c-ba39-80f53e210b24 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 12:35:51.440281 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:51.440812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:51.446675 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:51.447158 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:51.447589 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:51.448272 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:51.448724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:51.449146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:51.514772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-abddae76-68c9-4b79-a701-ece35266ba1a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "POST /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/action" status: 202 len: 0 microversion: 2.1 time: 0.077715 Aug 10 12:35:51.515574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 317/612] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:35:51 2022] POST /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:35:51.524016 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:51.524650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:51.530682 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:51.531169 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:51.531608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:51.532910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:51.533414 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:51.533856 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:51.663807 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:51.672133 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-301fbad3-b904-4d37-a6f1-81ebc678c910 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1721 microversion: 2.1 time: 0.151917 Aug 10 12:35:51.672685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 296/613] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:51 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:52.201476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d56475e9-7936-472b-b781-e67d3653c7d0"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:52.204093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:52.210349 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:52.210841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:52.211280 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:52.211978 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:52.212456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:52.212870 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:52.281576 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:52.617558 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d67bad5e-62b2-464f-af26-830cc9a95961 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420245 Aug 10 12:35:52.618147 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 318/614] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:35:52 2022] POST /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:52.693182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:52.693822 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:52.700098 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:52.700600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:52.701018 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:52.701737 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:52.702195 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:52.702623 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:52.831706 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:52.839566 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1159e77d-eb40-4784-ba1e-8cbef7d6c785 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1721 microversion: 2.1 time: 0.150264 Aug 10 12:35:52.840137 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 297/615] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:52 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:53.863204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:53.863845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:53.869903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:53.870382 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:53.870812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:53.871499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:53.871948 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:53.872389 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:53.999613 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:54.007449 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-88f6336e-32d7-40ef-b904-c07d6fd532a5 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1721 microversion: 2.1 time: 0.149780 Aug 10 12:35:54.008007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 319/616] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:53 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:55.028418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:55.029026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:55.035285 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:55.035825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:55.036256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:55.036988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:55.037472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:55.037895 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:55.167291 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:55.175820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bf8349a5-e5ca-495e-8fdb-5aa189d27d21 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1721 microversion: 2.1 time: 0.151252 Aug 10 12:35:55.176359 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 298/617] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:55 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:56.197543 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:56.198152 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:56.205286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:56.205766 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:56.206202 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:56.206889 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:56.207350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:56.207772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:56.337172 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:35:56.345126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-fbeac5fa-c806-4ee0-93da-d2aeb59d8957 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1727 microversion: 2.1 time: 0.151433 Aug 10 12:35:56.345712 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 320/618] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:35:56 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:56.365849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:56.366347 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:35:56.372839 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:56.373371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:56.373810 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:56.374508 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:56.374970 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:56.375401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:56.390212 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:56.452846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-caee65e1-4bd9-484c-a879-7ce03b6f8626 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090791 Aug 10 12:35:56.453472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 299/619] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 10 12:35:56 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:57.304296 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-436e2014-9a8f-4495-92cf-67db3d2228b2 req-0c515116-38c1-40b9-9e21-212d68701424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406145f8-c18f-42a6-ad69-122776fcde13", "tag": "925d1f21-e18a-4cdb-9515-0a2196cfef96"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:57.317806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-436e2014-9a8f-4495-92cf-67db3d2228b2 req-0c515116-38c1-40b9-9e21-212d68701424 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:57.318416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-436e2014-9a8f-4495-92cf-67db3d2228b2 req-0c515116-38c1-40b9-9e21-212d68701424 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:57.319040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-436e2014-9a8f-4495-92cf-67db3d2228b2 req-0c515116-38c1-40b9-9e21-212d68701424 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:57.332159 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-436e2014-9a8f-4495-92cf-67db3d2228b2 req-0c515116-38c1-40b9-9e21-212d68701424 service nova] Creating event network-changed:925d1f21-e18a-4cdb-9515-0a2196cfef96 for instance 406145f8-c18f-42a6-ad69-122776fcde13 on hv-cinder-85226 Aug 10 12:35:57.337061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-436e2014-9a8f-4495-92cf-67db3d2228b2 req-0c515116-38c1-40b9-9e21-212d68701424 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036754 Aug 10 12:35:57.337687 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 321/620] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:35:59.352221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-9faf0562-5071-446a-80ee-785a28f72ba8 req-0b0a8dbe-eef7-4908-bd3f-7f01f94a7b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406145f8-c18f-42a6-ad69-122776fcde13", "tag": "925d1f21-e18a-4cdb-9515-0a2196cfef96"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:59.361460 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-9faf0562-5071-446a-80ee-785a28f72ba8 req-0b0a8dbe-eef7-4908-bd3f-7f01f94a7b45 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:35:59.361929 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-9faf0562-5071-446a-80ee-785a28f72ba8 req-0b0a8dbe-eef7-4908-bd3f-7f01f94a7b45 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:35:59.362354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-9faf0562-5071-446a-80ee-785a28f72ba8 req-0b0a8dbe-eef7-4908-bd3f-7f01f94a7b45 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:35:59.374550 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-9faf0562-5071-446a-80ee-785a28f72ba8 req-0b0a8dbe-eef7-4908-bd3f-7f01f94a7b45 service nova] Creating event network-changed:925d1f21-e18a-4cdb-9515-0a2196cfef96 for instance 406145f8-c18f-42a6-ad69-122776fcde13 on hv-cinder-85226 Aug 10 12:35:59.379930 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-9faf0562-5071-446a-80ee-785a28f72ba8 req-0b0a8dbe-eef7-4908-bd3f-7f01f94a7b45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031858 Aug 10 12:35:59.380468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 300/621] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:36:02.245781 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d56475e9-7936-472b-b781-e67d3653c7d0"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:02.248208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:02.254748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:02.255230 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:02.255670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:02.256353 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:02.256805 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:02.257225 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:02.334448 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Invalid volume: volume d56475e9-7936-472b-b781-e67d3653c7d0 is already attached to instances: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: POST /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments HTTP/1.1 Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 74 Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:36:02.336527 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {"volumeAttachment": {"volumeId": "d56475e9-7936-472b-b781-e67d3653c7d0"}} Aug 10 12:36:02.338042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Invalid volume: volume d56475e9-7936-472b-b781-e67d3653c7d0 is already attached to instances: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'server_id': '3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88', 'body': {'volumeAttachment': {'volumeId': 'd56475e9-7936-472b-b781-e67d3653c7d0'}}} Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d56475e9-7936-472b-b781-e67d3653c7d0 is already attached to instances: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:02.338837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d56475e9-7936-472b-b781-e67d3653c7d0 is already attached to instances: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:02.339963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:02.341114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:02.341114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:36:02.341114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:36:02.341114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d56475e9-7936-472b-b781-e67d3653c7d0 is already attached to instances: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 Aug 10 12:36:02.341114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:02.341114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 400 to user: Invalid volume: volume d56475e9-7936-472b-b781-e67d3653c7d0 is already attached to instances: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:36:02.341114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5f57acd5-6c00-4240-8a57-81a54796a2d7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097172 Aug 10 12:36:02.341114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 322/622] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:36:02 2022] POST /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:36:02.403459 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:02.404039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:02.410163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:02.410641 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:02.411081 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:02.411769 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:02.412215 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:02.412664 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:02.490208 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lazy-loading 'services' on Instance uuid 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:36:02.560729 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6e4792a6-b8f3-4e6a-84b7-0ca7f4a27b35 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments/d56475e9-7936-472b-b781-e67d3653c7d0" status: 202 len: 0 microversion: 2.1 time: 0.161938 Aug 10 12:36:02.561342 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 301/623] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:36:02 2022] DELETE /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments/d56475e9-7936-472b-b781-e67d3653c7d0 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:36:02.570380 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:02.572604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:02.581696 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:02.582163 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:02.582604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:02.583314 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:02.583784 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:02.584211 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:02.614227 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7aa479ac-bb1e-42fa-b76c-e102014a3d1e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Aug 10 12:36:02.614807 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 323/624] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:02 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:03.628193 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:03.630457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:03.636514 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:03.637001 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:03.637465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:03.638239 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:03.638731 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:03.639152 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:03.668608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-08470da8-7330-44d8-8049-a82417fe16e6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045692 Aug 10 12:36:03.669149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 302/625] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:03 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:04.680282 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:04.682436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:04.688756 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:04.689231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:04.689692 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:04.690371 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:04.690820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:04.691239 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:04.718593 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3f884542-ade8-4086-aa7d-7f63120055cb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042190 Aug 10 12:36:04.719128 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 324/626] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:04 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:36:04.778142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:04.778641 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:04.785478 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:04.785985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:04.786420 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:04.787108 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:04.787562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:04.787984 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:04.811861 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:36:04.885517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bed5422a-6730-4452-831d-d764bd9c6286 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 204 len: 0 microversion: 2.1 time: 0.110748 Aug 10 12:36:04.886107 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 303/627] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:36:04 2022] DELETE /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:36:04.894931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:04.895535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:04.901401 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:04.901881 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:04.902310 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:04.902993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:04.903443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:04.903864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:05.083476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:05.090934 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-73feade3-7d75-4d05-a193-7856aef56ea1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1681 microversion: 2.1 time: 0.200391 Aug 10 12:36:05.091525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 325/628] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:04 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:06.114197 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:06.114883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:06.121145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:06.121659 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:06.122090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:06.122772 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:06.123219 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:06.123636 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:06.505938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:06.513317 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5f901666-712b-43f1-96d9-8754354d3264 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1681 microversion: 2.1 time: 0.403932 Aug 10 12:36:06.513880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 304/629] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:06 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1681 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:07.534742 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:07.535480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:07.542021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:07.542598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:07.543035 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:07.543729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:07.544181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:07.544603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:07.757843 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:07.765302 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-08de35df-c008-4db5-8eb4-6f8e892bce5e tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 200 len: 1681 microversion: 2.1 time: 0.234909 Aug 10 12:36:07.765865 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 326/630] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:07 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:07.969738 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-766a913b-7a34-415a-846d-a53ed87c498f req-3b2804c3-2952-4069-984d-3fcb6df7e183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88", "name": "network-vif-deleted", "tag": "eb383832-e054-468a-bbe7-6143a86ffefd"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:07.983422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-766a913b-7a34-415a-846d-a53ed87c498f req-3b2804c3-2952-4069-984d-3fcb6df7e183 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:07.983903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-766a913b-7a34-415a-846d-a53ed87c498f req-3b2804c3-2952-4069-984d-3fcb6df7e183 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:07.984519 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-766a913b-7a34-415a-846d-a53ed87c498f req-3b2804c3-2952-4069-984d-3fcb6df7e183 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:07.998004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-766a913b-7a34-415a-846d-a53ed87c498f req-3b2804c3-2952-4069-984d-3fcb6df7e183 service nova] Creating event network-vif-deleted:eb383832-e054-468a-bbe7-6143a86ffefd for instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 on hv-cinder-85226 Aug 10 12:36:08.003558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-766a913b-7a34-415a-846d-a53ed87c498f req-3b2804c3-2952-4069-984d-3fcb6df7e183 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038324 Aug 10 12:36:08.004841 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 305/631] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:08.787047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:08.787605 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:08.794103 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:08.794591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:08.795033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:08.795736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:08.796198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:08.796630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:08.811260 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 HTTP/1.1 Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:36:08.812834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:36:08.814909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88'} Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:36:08.815729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:36:08.817387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:08.819509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:36:08.819509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7eecd26a-4621-4f51-a6c3-5cea6594b9f7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 404 len: 111 microversion: 2.1 time: 0.031830 Aug 10 12:36:08.819509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 327/632] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:08 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:36:08.824154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-54a42bba-2c2d-4d19-a5d0-e0600ca52b51 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '.version_select at 0x7fcb92d9c280>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:08.845180 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-54a42bba-2c2d-4d19-a5d0-e0600ca52b51 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006767297" status: 202 len: 0 microversion: 2.1 time: 0.024546 Aug 10 12:36:08.845823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 306/633] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 10 12:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006767297 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:36:09.458263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f1c6a22b-f962-4a7c-905f-4a06bac7ffec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: .version_select at 0x7fcb9802fca0>, body: {"keypair": {"name": "tempest-keypair-1950414656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbjIB4kPBe2ApiuavN8DvdzX6+M3jZC2kyiWQ9e2crmpMsd4JzWnsLizg8YM7j8LnQkM71dDO5g+ZDVGhaMZYQzfOU3/ppnBep1qFAcgbxq4ALh3LYsKXkUlAa1EraWbA=="}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:09.474034 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-f1c6a22b-f962-4a7c-905f-4a06bac7ffec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for project 0bbb137a895941b1876eebfc56c28425. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:36:09.477867 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-f1c6a22b-f962-4a7c-905f-4a06bac7ffec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for user 9b8e4aad09814f8299a334639e34d948 and project 0bbb137a895941b1876eebfc56c28425. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:36:09.498984 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f1c6a22b-f962-4a7c-905f-4a06bac7ffec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045084 Aug 10 12:36:09.499554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 328/634] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:36:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:10.699872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-260616525", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69a0d312-b2de-4689-b0c5-62b84c9112b2"}], "security_groups": [{"name": "tempest-securitygroup--431731825"}], "key_name": "tempest-keypair-1950414656", "user_data": "}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:10.801905 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] validate_networks() for [('69a0d312-b2de-4689-b0c5-62b84c9112b2', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:36:11.164174 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:36:11.164601 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:36:11.165080 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:36:11.165534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:36:11.165955 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:36:11.174837 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:11.175321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:11.175761 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:11.176516 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:11.176962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:11.177421 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:11.194517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for project 0bbb137a895941b1876eebfc56c28425. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:36:11.198441 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Getting quotas for user 9b8e4aad09814f8299a334639e34d948 and project 0bbb137a895941b1876eebfc56c28425. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:36:11.209976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:36:11.212297 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:36:11.257962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5e09ee02-fd89-47a6-8306-5e956eef3187 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.563189 Aug 10 12:36:11.258610 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 307/635] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:36:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:36:11.270252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ee752db0-919f-4e4c-9e89-8bbe6dc5044c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:11.270865 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ee752db0-919f-4e4c-9e89-8bbe6dc5044c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:11.272790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:11.331447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ee752db0-919f-4e4c-9e89-8bbe6dc5044c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:11.340039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ee752db0-919f-4e4c-9e89-8bbe6dc5044c tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1241 microversion: 2.1 time: 0.074517 Aug 10 12:36:11.340932 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 329/636] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:11 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:12.361970 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:12.362754 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:12.365176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:12.370710 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:12.371263 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:12.371792 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:12.372624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:12.373336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:12.373820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:12.443434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:12.450941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2c4d0647-6681-4fe9-bf4c-6ce58e7e33ff tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1301 microversion: 2.1 time: 0.093496 Aug 10 12:36:12.451721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 308/637] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:12 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:36:13.472801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:13.473446 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:13.479708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:13.480196 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:13.480632 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:13.481355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:13.481817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:13.482830 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:13.584527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1585465032"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:13.585077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:13.591626 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:13.597310 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:13.597887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:13.598700 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:13.599529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:13.599771 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:13.676084 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:13.684512 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-619f9add-b7cd-4208-a332-6012467940e3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1366 microversion: 2.1 time: 0.216433 Aug 10 12:36:13.697951 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 330/638] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:13 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:13.731941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.network.security_group_api [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Removing security group 8e8309a9-8bd7-40a0-8ddc-8d4e438b16cd from port b96cc99c-2ad4-4023-a528-8c6512a0ba66 Aug 10 12:36:13.948131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-3ed799fb-1713-4784-a5ac-1975c03aaeca req-a6d6058d-8680-4c96-afe4-32822b60b0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d893e2b6-f8b6-4cfc-97e5-1257660aefc7", "tag": "3e9aa74e-4b3e-4476-9906-4d960251eeee"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:13.960669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-3ed799fb-1713-4784-a5ac-1975c03aaeca req-a6d6058d-8680-4c96-afe4-32822b60b0f2 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:13.961639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-3ed799fb-1713-4784-a5ac-1975c03aaeca req-a6d6058d-8680-4c96-afe4-32822b60b0f2 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:13.962363 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-3ed799fb-1713-4784-a5ac-1975c03aaeca req-a6d6058d-8680-4c96-afe4-32822b60b0f2 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:13.975266 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-3ed799fb-1713-4784-a5ac-1975c03aaeca req-a6d6058d-8680-4c96-afe4-32822b60b0f2 service nova] Creating event network-changed:3e9aa74e-4b3e-4476-9906-4d960251eeee for instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 on hv-cinder-85226 Aug 10 12:36:13.980215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-3ed799fb-1713-4784-a5ac-1975c03aaeca req-a6d6058d-8680-4c96-afe4-32822b60b0f2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035779 Aug 10 12:36:13.980798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 331/639] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:14.078480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bd00563a-2490-40a9-ac93-02e0e80c1e06 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "POST /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/action" status: 202 len: 0 microversion: 2.1 time: 0.497922 Aug 10 12:36:14.079666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 309/640] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:36:13 2022] POST /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:36:14.092788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-57dd2572-fb90-462f-a78e-f879ec6a590a req-fd3a5b61-a9a3-4f0f-a380-d5f106f3940b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc29cce-268e-4699-ad8d-7b096e9c30ed", "tag": "b96cc99c-2ad4-4023-a528-8c6512a0ba66"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:14.103694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-57dd2572-fb90-462f-a78e-f879ec6a590a req-fd3a5b61-a9a3-4f0f-a380-d5f106f3940b service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:14.104364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-57dd2572-fb90-462f-a78e-f879ec6a590a req-fd3a5b61-a9a3-4f0f-a380-d5f106f3940b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:14.104800 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-57dd2572-fb90-462f-a78e-f879ec6a590a req-fd3a5b61-a9a3-4f0f-a380-d5f106f3940b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:14.119628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-57dd2572-fb90-462f-a78e-f879ec6a590a req-fd3a5b61-a9a3-4f0f-a380-d5f106f3940b service nova] Creating event network-changed:b96cc99c-2ad4-4023-a528-8c6512a0ba66 for instance bfc29cce-268e-4699-ad8d-7b096e9c30ed on hv-cinder-85226 Aug 10 12:36:14.125345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-57dd2572-fb90-462f-a78e-f879ec6a590a req-fd3a5b61-a9a3-4f0f-a380-d5f106f3940b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036510 Aug 10 12:36:14.127575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 332/641] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:14.705990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:14.706596 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:14.712473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:14.712951 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:14.713421 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:14.714099 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:14.714547 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:14.714966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:14.940985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:14.949119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fd9d3a6e-562e-4c07-8218-77d0532a8a42 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1366 microversion: 2.1 time: 0.247477 Aug 10 12:36:14.956265 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 310/642] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:14 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:15.661073 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:15.661762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:15.668402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:15.668892 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:15.669359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:15.670058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:15.670517 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:15.670944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:15.752158 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lazy-loading 'services' on Instance uuid bfc29cce-268e-4699-ad8d-7b096e9c30ed {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:36:15.822510 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a18fb857-cec3-4cae-9607-cbbceca63014 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments/0bf5f438-1a48-4f13-b08c-35589339a039" status: 202 len: 0 microversion: 2.1 time: 0.165624 Aug 10 12:36:15.823102 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 333/643] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:36:15 2022] DELETE /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments/0bf5f438-1a48-4f13-b08c-35589339a039 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:36:15.831831 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:15.834090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:15.840395 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:15.840878 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:15.841344 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:15.842037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:15.842493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:15.842915 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:15.871280 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fef481e4-2c81-4816-96d0-94064ca99e4f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Aug 10 12:36:15.872020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 311/644] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:15 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:16.029578 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:16.030277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:16.036400 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:16.036893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:16.037357 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:16.038059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:16.038513 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:16.038940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:16.142635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-8e2a6235-8bf4-4d1b-b9b9-848119ebcd48 req-12ff8612-86d8-4218-904f-ef1f6d4edd3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfc29cce-268e-4699-ad8d-7b096e9c30ed", "tag": "b96cc99c-2ad4-4023-a528-8c6512a0ba66"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:16.151823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-8e2a6235-8bf4-4d1b-b9b9-848119ebcd48 req-12ff8612-86d8-4218-904f-ef1f6d4edd3e service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:16.152399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-8e2a6235-8bf4-4d1b-b9b9-848119ebcd48 req-12ff8612-86d8-4218-904f-ef1f6d4edd3e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:16.152892 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-8e2a6235-8bf4-4d1b-b9b9-848119ebcd48 req-12ff8612-86d8-4218-904f-ef1f6d4edd3e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:16.163856 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-8e2a6235-8bf4-4d1b-b9b9-848119ebcd48 req-12ff8612-86d8-4218-904f-ef1f6d4edd3e service nova] Creating event network-changed:b96cc99c-2ad4-4023-a528-8c6512a0ba66 for instance bfc29cce-268e-4699-ad8d-7b096e9c30ed on hv-cinder-85226 Aug 10 12:36:16.168869 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-8e2a6235-8bf4-4d1b-b9b9-848119ebcd48 req-12ff8612-86d8-4218-904f-ef1f6d4edd3e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029887 Aug 10 12:36:16.169639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 312/645] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:16.170447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:16.179390 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-95c552b5-0e7e-49d4-bff2-0ec8dad22355 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1366 microversion: 2.1 time: 0.206873 Aug 10 12:36:16.179954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 334/646] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:15 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:16.885573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:16.888397 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:16.894935 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:16.895427 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:16.895865 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:16.896570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:16.897025 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:16.897477 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:16.926082 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b95a8717-228e-4c2d-ac27-0cdbb4c22b5b tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Aug 10 12:36:16.926651 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 313/647] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:16 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:17.200108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:17.200734 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:17.207057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:17.207543 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:17.207977 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:17.208666 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:17.209117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:17.209564 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:17.472824 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:17.482061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d12a65a3-b23f-414a-9797-e311f0cb94a8 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1366 microversion: 2.1 time: 0.285807 Aug 10 12:36:17.483408 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 335/648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:17 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:17.937884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:17.940026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:17.946374 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:17.946862 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:17.947294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:17.947983 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:17.948441 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:17.948867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:17.976467 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cb925153-e1c9-49c1-8bd2-e24777bcf519 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042553 Aug 10 12:36:17.977005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 314/649] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:17 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:36:17.987916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:17.988348 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:17.994343 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:17.994834 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:17.995274 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:17.995967 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:17.996449 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:17.996877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:18.068601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] HTTP exception thrown: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed is not attached to volume 0bf5f438-1a48-4f13-b08c-35589339a039 Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Request method failure captured: Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: DELETE /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments/0bf5f438-1a48-4f13-b08c-35589339a039 HTTP/1.1 Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86WRh-wdiRJx1PJYC4eF-RCnY8ssUyzOGgqB1GYGV_TBDm6FKzMr7lDAdIY7J-3zcE8uWHCgxSLe22ZWeEU_lXVh9j4MDRgzYcWzp54CLvLTkmcHUP0KPhONPuVEQgkVT9YYPfxZZf9iCjxw5EcxP_LaARmJKcyuVdjEWTnL4tBu0yg Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: cb4fb7d34a90445e9677ce7287759724 Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-TestMinimumBasicScenario-459647247 Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:36:18.071020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cb4fb7d34a90445e9677ce7287759724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cb4fb7d34a90445e9677ce7287759724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cb4fb7d34a90445e9677ce7287759724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cb4fb7d34a90445e9677ce7287759724"}]}] Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-TestMinimumBasicScenario-459647247 Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: cb4fb7d34a90445e9677ce7287759724 Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-TestMinimumBasicScenario-459647247 Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-TestMinimumBasicScenario-459647247-project Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 618d31fc46f64971af696b219e8848a3 Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-TestMinimumBasicScenario-459647247-project Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:36:18.072614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed is not attached to volume 0bf5f438-1a48-4f13-b08c-35589339a039 Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'server_id': 'bfc29cce-268e-4699-ad8d-7b096e9c30ed', 'id': '0bf5f438-1a48-4f13-b08c-35589339a039'} Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0bf5f438-1a48-4f13-b08c-35589339a039. Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:36:18.073662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed is not attached to volume 0bf5f438-1a48-4f13-b08c-35589339a039 Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed is not attached to volume 0bf5f438-1a48-4f13-b08c-35589339a039 Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:18.075115 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Returning 404 to user: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed is not attached to volume 0bf5f438-1a48-4f13-b08c-35589339a039 {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:36:18.076289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f3aa39fb-a7e7-4f70-84fd-cce8b4af719e tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments/0bf5f438-1a48-4f13-b08c-35589339a039" status: 404 len: 154 microversion: 2.1 time: 0.089261 Aug 10 12:36:18.076289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 336/650] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:36:17 2022] DELETE /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed/os-volume_attachments/0bf5f438-1a48-4f13-b08c-35589339a039 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:36:18.504200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:18.504770 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:18.511667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:18.512260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:18.512764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:18.513605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:18.514119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:18.514608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:18.644299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:18.651740 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-62f423ba-20e9-4549-b747-0685b897afb4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1366 microversion: 2.1 time: 0.152205 Aug 10 12:36:18.652305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 315/651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:18 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:18.919315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-2c0e8271-9142-491c-b051-5c734d426da1 req-94ceacc4-de01-450e-96fb-704051bae85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893e2b6-f8b6-4cfc-97e5-1257660aefc7", "name": "network-vif-plugged", "status": "completed", "tag": "3e9aa74e-4b3e-4476-9906-4d960251eeee"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:18.930108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2c0e8271-9142-491c-b051-5c734d426da1 req-94ceacc4-de01-450e-96fb-704051bae85f service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:18.930592 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2c0e8271-9142-491c-b051-5c734d426da1 req-94ceacc4-de01-450e-96fb-704051bae85f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:18.931022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2c0e8271-9142-491c-b051-5c734d426da1 req-94ceacc4-de01-450e-96fb-704051bae85f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:18.941804 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-2c0e8271-9142-491c-b051-5c734d426da1 req-94ceacc4-de01-450e-96fb-704051bae85f service nova] Creating event network-vif-plugged:3e9aa74e-4b3e-4476-9906-4d960251eeee for instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 on hv-cinder-85226 Aug 10 12:36:18.946487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-2c0e8271-9142-491c-b051-5c734d426da1 req-94ceacc4-de01-450e-96fb-704051bae85f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030961 Aug 10 12:36:18.947074 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 337/652] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:19.211024 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:19.211556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:19.217986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:19.218471 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:19.218906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:19.219595 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:19.220051 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:19.220474 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:19.244814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:36:19.288805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:19.320636 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7e3ac18b-a1ac-4345-8594-0240b61aa4cf tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 204 len: 0 microversion: 2.1 time: 0.113190 Aug 10 12:36:19.321217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 316/653] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:36:19 2022] DELETE /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:36:19.329871 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:19.330568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:19.336683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:19.337170 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:19.337656 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:19.338346 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:19.338800 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:19.339225 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:19.470677 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:19.474003 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:19.481822 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7814bcd0-f133-45d7-b8c3-a2631253447f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1555 microversion: 2.1 time: 0.156131 Aug 10 12:36:19.497289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 338/654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:19 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:19.673067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:19.673815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:19.679734 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:19.680217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:19.680654 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:19.681468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:19.681929 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:19.682356 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:19.809176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:19.816518 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b867bcf7-1d2e-437d-9b2b-2d63a1f055b7 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1366 microversion: 2.1 time: 0.148337 Aug 10 12:36:19.817076 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 317/655] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:19 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:20.506093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:20.506699 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:20.514223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:20.514705 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:20.515147 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:20.515838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:20.516795 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:20.517220 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:20.649013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:20.656467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5c87a36e-4493-4ae7-b7df-ea6d1206ebe3 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1555 microversion: 2.1 time: 0.154237 Aug 10 12:36:20.657659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 339/656] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:20 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:20.837147 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:20.837818 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:20.844093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:20.845192 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:20.845653 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:20.846600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:20.847049 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:20.847473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:20.975571 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:20.982966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-54adecc2-9e71-4a97-b52f-2c6d23c016c1 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1366 microversion: 2.1 time: 0.149601 Aug 10 12:36:20.983521 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 318/657] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:20 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:21.677998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:21.678642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:21.680490 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=6 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:21.686042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:21.686524 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:21.686960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:21.687648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:21.688590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:21.689013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:21.817470 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:21.824841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-982010bb-2ae6-4dda-946b-107f1f0b032f tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1555 microversion: 2.1 time: 0.150676 Aug 10 12:36:21.825411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 340/658] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:21 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:36:22.004768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:22.005405 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:22.007401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:22.008118 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:22.014301 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:22.014786 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:22.015247 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:22.015939 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:22.016444 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:22.016872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:22.144262 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:22.151603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b435877d-0829-484a-9ae2-4616e89e303d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1366 microversion: 2.1 time: 0.151328 Aug 10 12:36:22.152158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 319/659] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:21 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:36:22.846642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:22.847948 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:22.854408 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:22.854890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:22.855328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:22.856020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:22.856475 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:22.856900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:23.010716 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:23.018645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-23670e99-34cb-4f12-bd98-621b0ac51fd0 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1555 microversion: 2.1 time: 0.176068 Aug 10 12:36:23.019201 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 341/660] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:22 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:23.171975 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:23.172691 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:23.179669 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:23.180314 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:23.180820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:23.182064 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:23.182064 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:23.182590 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:23.316237 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:23.323581 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-291560ab-2813-4b3e-a73d-9e1994b6475b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1557 microversion: 2.1 time: 0.155462 Aug 10 12:36:23.324147 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 320/661] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:23 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:23.344305 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:23.344801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:23.350905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:23.351391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:23.351835 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:23.352525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:23.352985 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:23.353437 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:23.445328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-34525589-e6d9-4fb1-9c18-c0f66fab5119 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104737 Aug 10 12:36:23.446029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 342/662] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 10 12:36:23 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:23.528661 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-7d50648c-334c-40fd-a276-9e094bc05431 req-93c18135-02f9-4ae5-8e06-934848f8cb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfc29cce-268e-4699-ad8d-7b096e9c30ed", "name": "network-vif-deleted", "tag": "b96cc99c-2ad4-4023-a528-8c6512a0ba66"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:23.538172 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7d50648c-334c-40fd-a276-9e094bc05431 req-93c18135-02f9-4ae5-8e06-934848f8cb6e service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:23.538739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7d50648c-334c-40fd-a276-9e094bc05431 req-93c18135-02f9-4ae5-8e06-934848f8cb6e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:23.539235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7d50648c-334c-40fd-a276-9e094bc05431 req-93c18135-02f9-4ae5-8e06-934848f8cb6e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:23.551174 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-7d50648c-334c-40fd-a276-9e094bc05431 req-93c18135-02f9-4ae5-8e06-934848f8cb6e service nova] Creating event network-vif-deleted:b96cc99c-2ad4-4023-a528-8c6512a0ba66 for instance bfc29cce-268e-4699-ad8d-7b096e9c30ed on hv-cinder-85226 Aug 10 12:36:23.555969 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-7d50648c-334c-40fd-a276-9e094bc05431 req-93c18135-02f9-4ae5-8e06-934848f8cb6e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031030 Aug 10 12:36:23.556554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 321/663] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:24.040647 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:24.041458 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:24.048044 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:24.048479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:24.048919 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:24.049642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:24.050105 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:24.050535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:24.080255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:24.080661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:24.081104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:24.081836 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lazy-loading 'fault' on Instance uuid bfc29cce-268e-4699-ad8d-7b096e9c30ed {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:36:24.122404 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618d31fc46f64971af696b219e8848a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4fb7d34a90445e9677ce7287759724', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:24.129904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c3ad5267-2d05-4054-b874-4ef2e820dca7 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 200 len: 1348 microversion: 2.1 time: 0.093687 Aug 10 12:36:24.130480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 343/664] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:24 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:24.612293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-7d2fce63-a828-45e5-8d2c-ba9cbb2b5b5f req-26743765-eac5-49f2-95d7-fbe872adae2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d893e2b6-f8b6-4cfc-97e5-1257660aefc7", "tag": "3e9aa74e-4b3e-4476-9906-4d960251eeee"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:24.622277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7d2fce63-a828-45e5-8d2c-ba9cbb2b5b5f req-26743765-eac5-49f2-95d7-fbe872adae2f service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:24.622772 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7d2fce63-a828-45e5-8d2c-ba9cbb2b5b5f req-26743765-eac5-49f2-95d7-fbe872adae2f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:24.623202 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-7d2fce63-a828-45e5-8d2c-ba9cbb2b5b5f req-26743765-eac5-49f2-95d7-fbe872adae2f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:24.635130 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-7d2fce63-a828-45e5-8d2c-ba9cbb2b5b5f req-26743765-eac5-49f2-95d7-fbe872adae2f service nova] Creating event network-changed:3e9aa74e-4b3e-4476-9906-4d960251eeee for instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 on hv-cinder-85226 Aug 10 12:36:24.639980 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-7d2fce63-a828-45e5-8d2c-ba9cbb2b5b5f req-26743765-eac5-49f2-95d7-fbe872adae2f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032094 Aug 10 12:36:24.640500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 322/665] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:25.150618 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:25.151866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] [instance: bfc29cce-268e-4699-ad8d-7b096e9c30ed] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:25.158974 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:25.159799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:25.160276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:25.161206 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:25.161722 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:25.162157 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:25.176298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] HTTP exception thrown: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed could not be found. Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Request method failure captured: Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed HTTP/1.1 Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86WRh-wdiRJx1PJYC4eF-RCnY8ssUyzOGgqB1GYGV_TBDm6FKzMr7lDAdIY7J-3zcE8uWHCgxSLe22ZWeEU_lXVh9j4MDRgzYcWzp54CLvLTkmcHUP0KPhONPuVEQgkVT9YYPfxZZf9iCjxw5EcxP_LaARmJKcyuVdjEWTnL4tBu0yg Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: cb4fb7d34a90445e9677ce7287759724 Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-TestMinimumBasicScenario-459647247 Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:36:25.178000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cb4fb7d34a90445e9677ce7287759724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cb4fb7d34a90445e9677ce7287759724"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cb4fb7d34a90445e9677ce7287759724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cb4fb7d34a90445e9677ce7287759724"}]}] Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-TestMinimumBasicScenario-459647247 Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: cb4fb7d34a90445e9677ce7287759724 Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-TestMinimumBasicScenario-459647247 Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-TestMinimumBasicScenario-459647247-project Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 618d31fc46f64971af696b219e8848a3 Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-TestMinimumBasicScenario-459647247-project Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed could not be found. Aug 10 12:36:25.179294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'bfc29cce-268e-4699-ad8d-7b096e9c30ed'} Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed could not be found. Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:36:25.180016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed could not be found. Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed could not be found. Aug 10 12:36:25.181219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:36:25.182480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Returning 404 to user: Instance bfc29cce-268e-4699-ad8d-7b096e9c30ed could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:36:25.182480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7320e3a6-e7a2-4e41-a171-65d77254f9cb tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed" status: 404 len: 111 microversion: 2.1 time: 0.032581 Aug 10 12:36:25.182480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 344/666] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:25 2022] GET /compute/v2.1/servers/bfc29cce-268e-4699-ad8d-7b096e9c30ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:36:25.188857 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-448c1e06-3f36-4a81-82d6-06bde6121ea2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] Calling method '.version_select at 0x7fcb9806b940>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:25.211609 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-448c1e06-3f36-4a81-82d6-06bde6121ea2 tempest-TestMinimumBasicScenario-459647247 tempest-TestMinimumBasicScenario-459647247-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2127501302" status: 202 len: 0 microversion: 2.1 time: 0.026609 Aug 10 12:36:25.216433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 323/667] 10.222.0.65 () {58 vars in 1272 bytes} [Wed Aug 10 12:36:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2127501302 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:36:33.780994 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:33.782053 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:33.787863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:33.788358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:33.788794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:33.789520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:33.790017 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:33.790403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:33.815283 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a4590d3d-bf6e-4e87-bc93-e787566bf6e5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/ips" status: 200 len: 149 microversion: 2.20 time: 0.210349 Aug 10 12:36:33.816027 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 345/668] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 10 12:36:33 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/ips => generated 149 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:36:36.058393 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:36.059135 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:36.063686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:36.064320 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:36.077358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:36.077850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:36.078329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:36.079035 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:36.081924 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:36.082895 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:36.149505 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lazy-loading 'flavor' on Instance uuid abef27e9-175c-4101-80ee-6da94e239088 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:36:36.352489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e97e3a2d-1c83-42c8-b936-3e28380c109a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/action" status: 202 len: 0 microversion: 2.20 time: 0.293998 Aug 10 12:36:36.353300 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 324/669] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 10 12:36:36 2022] POST /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:36:36.362298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:36.362898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:36.373989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:36.374617 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:36.377863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:36.379208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:36.379781 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:36.382205 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:36.561515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:36.575039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:36.577768 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:36.581476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-937c4067-6af0-44d3-b263-d1f445e36e4c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.223288 Aug 10 12:36:36.582786 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 346/670] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:36 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:37.608121 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:37.608804 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:37.616593 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:37.617087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:37.617548 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:37.618260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:37.618714 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:37.619136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:37.784014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:37.792231 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:37.793781 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:37.794957 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-67fb71f1-d5e7-4841-abec-619f3ccda869 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.191850 Aug 10 12:36:37.795528 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 325/671] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:37 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:38.444933 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:38.446039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:38.453858 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:38.454529 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:38.455154 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:38.456039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:38.456672 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:38.457104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:38.555659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lazy-loading 'services' on Instance uuid 406145f8-c18f-42a6-ad69-122776fcde13 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:36:38.649745 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0890a2fe-a2db-447c-af8e-f3559e0481c9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "DELETE /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments/7e1d04b0-0c77-4f6c-ba39-80f53e210b24" status: 202 len: 0 microversion: 2.1 time: 0.211106 Aug 10 12:36:38.655304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 347/672] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:36:38 2022] DELETE /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments/7e1d04b0-0c77-4f6c-ba39-80f53e210b24 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:36:38.660792 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:38.665422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:38.678561 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:38.679419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:38.680038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:38.680918 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:38.681585 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:38.682379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:38.727302 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7df0fc48-87ea-4fe3-b94e-11ea84807a4e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072083 Aug 10 12:36:38.727942 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 326/673] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:38 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:36:38.819070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:38.819916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:38.826777 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:38.827810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:38.828348 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:38.829434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:38.830087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:38.830519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:39.039494 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:39.050309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:39.050612 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:39.052031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ebd62d9a-abc7-4f20-8c00-8707e3a5278f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.237467 Aug 10 12:36:39.056551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 348/674] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:38 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:39.740996 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:39.743197 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:39.756427 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:39.757053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:39.757569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:39.758583 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:39.759218 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:39.759676 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:39.793154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4b1dcde2-7e85-4a82-a94b-18b13eace5de tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055893 Aug 10 12:36:39.794096 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 327/675] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:39 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:36:39.888921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:39.890042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:39.897638 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:39.898308 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:39.898905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:39.899780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:39.900373 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:39.900936 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:39.932511 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:36:40.035880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cdb441f5-6fb0-4df9-a480-3e9efb58fdc6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "DELETE /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 204 len: 0 microversion: 2.1 time: 0.150425 Aug 10 12:36:40.036925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 349/676] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:36:39 2022] DELETE /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:36:40.046093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:40.046706 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:40.053434 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:40.053955 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:40.054390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:40.055405 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:40.055871 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:40.056297 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:40.079706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:40.080503 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:40.103757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:40.104406 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:40.104940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:40.105805 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:40.106335 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:40.106939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:40.257344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:40.268067 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:40.271557 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:40.274118 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ac2ac454-74bc-41f6-9f19-3ef828faf07a tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.202506 Aug 10 12:36:40.277614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 350/677] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:40 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:40.354269 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:40.364430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e8611042-ab71-426c-8334-5c45907a1a4d tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1687 microversion: 2.1 time: 0.322793 Aug 10 12:36:40.373946 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 328/678] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:40 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1687 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:41.302460 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:41.303073 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:41.309197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:41.311530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:41.315024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:41.315746 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:41.316683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:41.317404 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:41.317986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:41.388656 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:41.389311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:41.400879 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:41.401408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:41.401857 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:41.402578 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:41.403040 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:41.403468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:41.576548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:41.586965 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:41.588507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:41.590876 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-23ca88a4-9560-4d21-9374-91d7b9905d56 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.292445 Aug 10 12:36:41.600612 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 351/679] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:41 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:41.701952 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:41.721997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bf0bd5ac-7b37-48aa-b0ba-e5e07573dc65 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1687 microversion: 2.1 time: 0.336639 Aug 10 12:36:41.737955 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 329/680] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:41 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1687 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:36:42.651774 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:42.652405 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:42.665969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:42.666931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:42.667424 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:42.668545 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:42.669008 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:42.669660 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:42.748758 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:42.750643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:42.761519 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:42.762606 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:42.763287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:42.764225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:42.765013 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:42.766365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:42.855879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:42.865646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:42.868466 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:42.870075 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-097b27b9-60bf-4e6a-ae9d-91be376599af tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.238436 Aug 10 12:36:42.871142 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 352/681] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:42 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:43.015559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:43.026007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ab9e1009-5d2f-41f4-b3dc-5f9be10088f3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1687 microversion: 2.1 time: 0.282798 Aug 10 12:36:43.035897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 330/682] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:42 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1687 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:43.405973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-bccb38a6-b7e8-4595-91ee-c233f27d5042 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Action: 'create', calling method: .version_select at 0x7fcb92e763a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1160807107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLhL0VBaNSjQhymQZK0tdvcXrdZVa49kQRPHl8sHzMMhGK9Nz01YbZEWUqMdE7AH8XcMsf1pq2DmaowFOS4Gn4gxmHQOuDy2wHhKWAoAlUrM8QdproFit4UiGehwHoc3Q=="}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:43.421405 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-bccb38a6-b7e8-4595-91ee-c233f27d5042 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Getting quotas for project f63c30b5d2af4144b096b78c7ab308a7. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:36:43.425741 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-bccb38a6-b7e8-4595-91ee-c233f27d5042 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Getting quotas for user 770127af5f494b7e9198438441868fa1 and project f63c30b5d2af4144b096b78c7ab308a7. Resources: {'key_pairs'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:36:43.447952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-bccb38a6-b7e8-4595-91ee-c233f27d5042 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.203570 Aug 10 12:36:43.448545 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 353/683] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:36:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:43.894251 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:43.895430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:43.902887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:43.904106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:43.904556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:43.905569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:43.906024 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:43.906823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:44.046517 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:44.055548 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:44.057094 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:44.057215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:44.058006 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:44.058383 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-410dc45d-da88-4922-94ac-73811f480cf5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.168073 Aug 10 12:36:44.058949 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 331/684] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:43 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:44.077055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:44.077690 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:44.078249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:44.079050 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:44.079574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:44.080074 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:44.349656 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:44.360553 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-81a46b47-b604-4e51-9f7d-f1cf8c900084 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1687 microversion: 2.1 time: 0.312083 Aug 10 12:36:44.364483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 354/685] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:44 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1687 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:45.082923 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:45.083739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:45.092309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:45.094604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:45.095188 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:45.096291 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:45.096853 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:45.097414 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:45.288153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:45.304095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:45.306587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:45.308325 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-66ec9bee-ee46-49ba-8cf5-908de01675cd tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.229735 Aug 10 12:36:45.322763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 332/686] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:45 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:45.388142 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:45.389532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:45.400247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:45.401764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:45.402210 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:45.406284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:45.406962 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:45.407643 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:45.481847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:45.491246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-974a79bd-d3dc-4210-9d34-f0ead2aa2e12 req-bfb29937-1ae8-494b-9c4d-b2d98aaa19e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406145f8-c18f-42a6-ad69-122776fcde13", "name": "network-vif-deleted", "tag": "925d1f21-e18a-4cdb-9515-0a2196cfef96"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:45.534040 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-974a79bd-d3dc-4210-9d34-f0ead2aa2e12 req-bfb29937-1ae8-494b-9c4d-b2d98aaa19e0 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:45.537943 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-974a79bd-d3dc-4210-9d34-f0ead2aa2e12 req-bfb29937-1ae8-494b-9c4d-b2d98aaa19e0 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:45.538396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-974a79bd-d3dc-4210-9d34-f0ead2aa2e12 req-bfb29937-1ae8-494b-9c4d-b2d98aaa19e0 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:45.555899 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-974a79bd-d3dc-4210-9d34-f0ead2aa2e12 req-bfb29937-1ae8-494b-9c4d-b2d98aaa19e0 service nova] Creating event network-vif-deleted:925d1f21-e18a-4cdb-9515-0a2196cfef96 for instance 406145f8-c18f-42a6-ad69-122776fcde13 on hv-cinder-85226 Aug 10 12:36:45.583445 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:45.599660 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4d1e6a8f-d289-4be9-a32b-552418f95aa3 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 200 len: 1620 microversion: 2.1 time: 0.216072 Aug 10 12:36:45.600255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 355/687] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:45 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 1620 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:45.612724 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-974a79bd-d3dc-4210-9d34-f0ead2aa2e12 req-bfb29937-1ae8-494b-9c4d-b2d98aaa19e0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225480 Aug 10 12:36:45.614084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 333/688] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:36:46.332829 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:46.333704 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:46.356615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:46.357218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:46.357955 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:46.358920 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:46.360354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:46.361027 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:46.539684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:46.550083 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:46.555107 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:46.556551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-27512560-48da-461f-b7bd-55eeaf409cca tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.228372 Aug 10 12:36:46.557298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 356/689] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:46 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:46.623159 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:46.623872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 406145f8-c18f-42a6-ad69-122776fcde13] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:46.630196 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:46.630725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:46.631162 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:46.632080 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:46.632545 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:46.632980 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:46.648625 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] HTTP exception thrown: Instance 406145f8-c18f-42a6-ad69-122776fcde13 could not be found. Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Request method failure captured: Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 HTTP/1.1 Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UVCZy5cePM0_ipeKQGog--zdcGvp9RYAIh0ETNO7C_3X7o1pwdTynr0ywJx0KC7nZ4LUrhMqxiuprvTLwbCri2KCNWuuLilVY1_i-Mk6T1KxaJyBHdOkYA6xYKYWVs9Sp5sN4E6C3M9XINhC3x5-uhV528eibATDOc31y-O2lsFbU Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:36:46.650465 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2301f937213e47c29686be4e8601ac32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2301f937213e47c29686be4e8601ac32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}] Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 2aa6d6d56f9f4618ae3883c9beb2e77b Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 406145f8-c18f-42a6-ad69-122776fcde13 could not be found. Aug 10 12:36:46.651846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '406145f8-c18f-42a6-ad69-122776fcde13'} Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406145f8-c18f-42a6-ad69-122776fcde13 could not be found. Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:36:46.652639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406145f8-c18f-42a6-ad69-122776fcde13 could not be found. Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406145f8-c18f-42a6-ad69-122776fcde13 could not be found. Aug 10 12:36:46.654067 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:46.655398 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Returning 404 to user: Instance 406145f8-c18f-42a6-ad69-122776fcde13 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:36:46.655398 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-35f20957-782a-4a7e-a447-677b04eae76b tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13" status: 404 len: 111 microversion: 2.1 time: 0.033902 Aug 10 12:36:46.655398 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 334/690] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:46 2022] GET /compute/v2.1/servers/406145f8-c18f-42a6-ad69-122776fcde13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:36:46.661249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1742d6ef-85ce-466c-ad6e-6ea29e99a14e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '.version_select at 0x7fcb92ee4310>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:46.681059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1742d6ef-85ce-466c-ad6e-6ea29e99a14e tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376343480" status: 202 len: 0 microversion: 2.1 time: 0.023561 Aug 10 12:36:46.681710 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 357/691] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 10 12:36:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376343480 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:36:47.581134 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:47.581693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:47.587620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:47.588111 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:47.588555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:47.589248 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:47.589741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:47.590178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:47.725912 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:47.735033 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:47.736914 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:47.738205 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-be8f9ef4-a3c3-4fc7-ae47-c8ea98dc1831 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.161040 Aug 10 12:36:47.738783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 335/692] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:47 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:48.763795 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:48.764407 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:48.771166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:48.771703 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:48.772144 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:48.772914 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:48.773392 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:48.773816 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:48.914463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:48.922898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:48.924430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:48.925624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d7f4ba0e-a6e7-4e38-bbcc-e13ccb6b8049 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.166293 Aug 10 12:36:48.926176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 358/693] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:48 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:49.663214 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:49.663732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:49.670052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:49.670535 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:49.670971 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:49.671660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:49.672118 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:49.672545 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:49.697640 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:36:49.772847 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9f4d3474-6b48-4b88-b62a-1b483d3cafd6 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "DELETE /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 204 len: 0 microversion: 2.1 time: 0.113043 Aug 10 12:36:49.773684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 336/694] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:36:49 2022] DELETE /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:36:49.781994 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:49.782697 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:49.789011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:49.789526 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:49.790085 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:49.790857 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:49.791316 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:49.791742 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:49.925207 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:49.933101 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-76ffb0cb-a7b2-4c6a-8c8f-1300334ddd36 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1507 microversion: 2.1 time: 0.154822 Aug 10 12:36:49.933700 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 359/695] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:49 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:49.948444 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:49.949164 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:49.955537 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:49.956020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:49.956473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:49.957141 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:49.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:49.958061 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:50.092118 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:50.100732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:50.102266 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:50.103409 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-eb76bad7-382f-4710-adb6-58fa6801b858 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.159292 Aug 10 12:36:50.103976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 337/696] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:49 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:50.891836 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:50.894231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:50.900976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:50.901490 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:50.901923 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:50.902628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:50.903079 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:50.903503 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:50.932015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-34f1334e-1fac-4dbd-add0-272b8c2f634b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044588 Aug 10 12:36:50.932485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 360/697] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:36:50 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:36:50.954715 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:50.955339 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:50.961662 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:50.962143 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:50.962578 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:50.963269 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:50.963719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:50.964141 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:50.969244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:50.998814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:50.999598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:51.006091 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:51.006586 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:51.007029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:51.007738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:51.008200 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:51.008632 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:51.035077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:36:51.103282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:51.111749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3e9b042e-8ce7-4991-87a7-97a888df10b9 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1507 microversion: 2.1 time: 0.161311 Aug 10 12:36:51.112237 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4bda77d3-e42c-4504-acf0-ce70feeea5f3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 204 len: 0 microversion: 2.1 time: 0.116942 Aug 10 12:36:51.126240 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 338/698] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:50 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:51.126476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 361/699] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:36:50 2022] DELETE /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 12:36:51.126588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:51.126588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:51.128497 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:51.128617 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:51.128985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:51.129307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:51.129470 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:51.130137 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:51.130594 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:51.131020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:51.135306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:51.135790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:51.136297 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:51.137019 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:51.137520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:51.137946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:51.266869 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:51.272385 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:51.274449 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cb241b1a-b0ad-4b76-bf77-c361cc4c1435 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1674 microversion: 2.1 time: 0.156851 Aug 10 12:36:51.275350 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 339/700] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:51 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:36:51.282055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:51.283576 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:51.284772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9f015434-4122-43f4-94b9-c73fcd6d8566 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.161984 Aug 10 12:36:51.285345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 362/701] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:51 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:52.133994 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:52.134522 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:52.141573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:52.142095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:52.142548 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:52.143266 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:52.143724 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:52.144176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:52.276660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:52.284733 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5ccf98b4-c695-4c81-b256-43e811a0912a tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1507 microversion: 2.1 time: 0.154774 Aug 10 12:36:52.285303 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 340/702] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:52 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:52.295684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:52.296294 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:52.303458 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:52.304131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:52.304587 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:52.307829 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:52.308007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:52.308409 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:52.308615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:52.308825 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:52.314649 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:52.315134 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:52.315568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:52.316260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:52.316715 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:52.317140 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:52.447131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:52.447295 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:52.455430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-51b4850c-6931-4797-933a-7f35415290f6 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1674 microversion: 2.1 time: 0.163607 Aug 10 12:36:52.456356 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 363/703] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:52 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:52.459733 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:52.461244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:52.462443 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-51cbab35-2563-4819-89ff-1ddee4aae11c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.158573 Aug 10 12:36:52.462985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 341/704] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:52 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:53.304783 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:53.305422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:53.312196 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:53.312635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:53.313072 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:53.313792 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:53.314282 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:53.314711 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:53.432563 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=4 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:53.445699 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:53.453057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4c61abc5-3ddf-4bfe-86bf-39992f14e0d1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1507 microversion: 2.1 time: 0.152303 Aug 10 12:36:53.454150 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 364/705] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:53 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:53.476242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:53.476853 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:53.484471 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:53.484935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:53.485061 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:53.485422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:53.485581 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:53.486129 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:53.486587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:53.487127 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:53.491418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:53.491909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:53.492348 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:53.493042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:53.493536 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:53.493959 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:53.619297 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:53.626867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e3026f8a-a3b1-4ccc-b661-d08e02ff6283 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1674 microversion: 2.1 time: 0.154399 Aug 10 12:36:53.627442 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 342/706] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:53 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:53.628164 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:53.636235 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:53.637787 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:53.638945 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-eecb79ec-df23-48a7-a9b6-d09c1cbd5b97 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.157971 Aug 10 12:36:53.639502 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 365/707] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:53 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:54.474714 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:54.475238 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:54.482154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:54.483402 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:54.483845 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:54.484588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:54.485052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:54.485509 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:54.629217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:54.637205 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1583514e-a3a3-45c0-be83-4071ad07cb69 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1507 microversion: 2.1 time: 0.166734 Aug 10 12:36:54.637796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 343/708] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:54 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:54.648158 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:54.649439 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:54.657434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:54.662905 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:54.663266 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:54.663798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:54.664604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:54.665286 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:54.667540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:54.667981 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:54.676758 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:54.677294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:54.677759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:54.678461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:54.678914 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:54.679336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:54.832332 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:54.843021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:54.844740 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:54.846508 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-20de1e25-8680-4b37-b9c4-c1c07150b523 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.187035 Aug 10 12:36:54.847167 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 344/709] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:54 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:54.957786 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:54.968393 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8c305380-84fe-478f-9e9a-221ecfe1d228 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1674 microversion: 2.1 time: 0.323955 Aug 10 12:36:54.968936 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 366/710] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:54 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1674 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:36:55.031941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-4cd5d9d1-37ad-4698-afb2-919b253bad0f req-fbb294d8-7b2e-4d76-aa8d-589daa99482b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d7d249-4da8-479b-aba1-6fcadbe4e731", "name": "network-vif-deleted", "tag": "dd8cd6a6-e946-4e31-a189-f179b73d0d26"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:55.042573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4cd5d9d1-37ad-4698-afb2-919b253bad0f req-fbb294d8-7b2e-4d76-aa8d-589daa99482b service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:55.043142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4cd5d9d1-37ad-4698-afb2-919b253bad0f req-fbb294d8-7b2e-4d76-aa8d-589daa99482b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:55.043638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4cd5d9d1-37ad-4698-afb2-919b253bad0f req-fbb294d8-7b2e-4d76-aa8d-589daa99482b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:55.055544 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-4cd5d9d1-37ad-4698-afb2-919b253bad0f req-fbb294d8-7b2e-4d76-aa8d-589daa99482b service nova] Creating event network-vif-deleted:dd8cd6a6-e946-4e31-a189-f179b73d0d26 for instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 on hv-cinder-85226 Aug 10 12:36:55.060346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-4cd5d9d1-37ad-4698-afb2-919b253bad0f req-fbb294d8-7b2e-4d76-aa8d-589daa99482b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033406 Aug 10 12:36:55.061411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 345/711] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:55.659585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:55.660196 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:55.666418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:55.666911 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:55.667356 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:55.668079 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:55.668523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:55.668953 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:55.710790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:55.711283 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:55.711728 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:55.712181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lazy-loading 'fault' on Instance uuid 15d7d249-4da8-479b-aba1-6fcadbe4e731 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:36:55.771150 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:55.779503 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4e1ea0c6-2c5d-4f70-9de7-c01b6d03ecca tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 200 len: 1311 microversion: 2.1 time: 0.123697 Aug 10 12:36:55.780370 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 367/712] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:55 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:55.873290 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:55.874667 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:55.881990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:55.882910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:55.883407 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:55.884404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:55.884931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:55.885390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:55.991375 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:55.992857 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:55.998970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:55.999453 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.000035 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:56.001344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:56.001806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.002227 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:56.038982 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:56.039897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.040414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:56.040934 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lazy-loading 'fault' on Instance uuid 67832a65-635c-45ac-830c-7ae989a1fea6 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:36:56.042076 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:56.050446 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:56.051957 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:56.053140 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-34370730-9698-4a5f-aa2e-c85eb90760a6 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.184818 Aug 10 12:36:56.053746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 346/713] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:55 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:56.086908 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:56.094747 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6caa5be4-8d4a-4e4d-aba2-68df7325f3ee tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 200 len: 1327 microversion: 2.1 time: 0.107374 Aug 10 12:36:56.095316 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 368/714] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:55 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:36:56.799924 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:56.800570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: 15d7d249-4da8-479b-aba1-6fcadbe4e731] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:56.806576 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:56.807062 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.807502 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:56.808193 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:56.808650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.809078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:56.822704 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] HTTP exception thrown: Instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 could not be found. Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Request method failure captured: Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 HTTP/1.1 Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UVCZy5cePM0_ipeKQGog--zdcGvp9RYAIh0ETNO7C_3X7o1pwdTynr0ywJx0KC7nZ4LUrhMqxiuprvTLwbCri2KCNWuuLilVY1_i-Mk6T1KxaJyBHdOkYA6xYKYWVs9Sp5sN4E6C3M9XINhC3x5-uhV528eibATDOc31y-O2lsFbU Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:36:56.824319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2301f937213e47c29686be4e8601ac32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2301f937213e47c29686be4e8601ac32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}] Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 2aa6d6d56f9f4618ae3883c9beb2e77b Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 could not be found. Aug 10 12:36:56.825794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '15d7d249-4da8-479b-aba1-6fcadbe4e731'} Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 could not be found. Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:36:56.826534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 could not be found. Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 could not be found. Aug 10 12:36:56.827681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:56.829411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Returning 404 to user: Instance 15d7d249-4da8-479b-aba1-6fcadbe4e731 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:36:56.829411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-39290262-b86a-49b4-8798-8a60b4642d76 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731" status: 404 len: 111 microversion: 2.1 time: 0.029694 Aug 10 12:36:56.829411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 347/715] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:56 2022] GET /compute/v2.1/servers/15d7d249-4da8-479b-aba1-6fcadbe4e731 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 12:36:56.834803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:56.835297 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:56.841778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:56.842261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.842698 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:56.843387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:56.843844 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.844270 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:56.871332 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:36:56.897583 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:56.956073 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-387bcbc6-d97f-4959-a32f-2ded413d8250 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 204 len: 0 microversion: 2.1 time: 0.124696 Aug 10 12:36:56.957137 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 369/716] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:36:56 2022] DELETE /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:36:56.966717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:56.967355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:56.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:56.974903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.975387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:56.976077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:56.976530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:56.976949 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:57.076413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:57.077110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:57.083562 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:57.084042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:57.084472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:57.085162 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:57.085635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:57.086055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:57.107052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:57.114999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6bcd1426-7a1f-4936-85f2-191a91c7d044 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.153412 Aug 10 12:36:57.115487 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 348/717] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:56 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:57.130490 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-c766b591-783a-40bb-87cd-d1916677fc21 req-b87b95a9-8757-4ec2-a79a-6402ab7b2f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67832a65-635c-45ac-830c-7ae989a1fea6", "name": "network-vif-deleted", "tag": "6d220b97-f3b8-4e54-a5e7-2f570e5e93a2"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:57.139642 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c766b591-783a-40bb-87cd-d1916677fc21 req-b87b95a9-8757-4ec2-a79a-6402ab7b2f95 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:57.140149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c766b591-783a-40bb-87cd-d1916677fc21 req-b87b95a9-8757-4ec2-a79a-6402ab7b2f95 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:57.140600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c766b591-783a-40bb-87cd-d1916677fc21 req-b87b95a9-8757-4ec2-a79a-6402ab7b2f95 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:57.152375 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-c766b591-783a-40bb-87cd-d1916677fc21 req-b87b95a9-8757-4ec2-a79a-6402ab7b2f95 service nova] Creating event network-vif-deleted:6d220b97-f3b8-4e54-a5e7-2f570e5e93a2 for instance 67832a65-635c-45ac-830c-7ae989a1fea6 on hv-cinder-85226 Aug 10 12:36:57.157113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-c766b591-783a-40bb-87cd-d1916677fc21 req-b87b95a9-8757-4ec2-a79a-6402ab7b2f95 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030126 Aug 10 12:36:57.157797 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 349/718] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:57.162638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:57.163332 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:57.169255 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:57.169778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:57.170223 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:57.170909 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:57.171442 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:57.171790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:57.185097 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] HTTP exception thrown: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Request method failure captured: Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 HTTP/1.1 Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86VgyCRtfgzAcEXdAoLyUdT611H3LZWMB5IORGUmu_HfvGJR8lRMXsA7LwUeDhSPJEKjWicgTHzu12Xhc38t-dQgD1RapqsF5uxR8QUKno3rqapAQ8JTeVemiuRPj5TiBo7i23EXGfxGHjQcZ4keQIrKBUipfk83wuFCgaadQAvlGv8 Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:36:57.186776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82c24c64f4c34921837eceb32e24a287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}] Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: e6842565de354b0c85b04940d57c7432 Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:36:57.188834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '67832a65-635c-45ac-830c-7ae989a1fea6'} Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:36:57.189605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:36:57.191191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:36:57.192967 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Returning 404 to user: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:36:57.192967 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d0b2543f-52ca-48f4-b1b3-a6e909f570d4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 404 len: 111 microversion: 2.1 time: 0.029950 Aug 10 12:36:57.192967 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 350/719] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:57 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:36:57.199989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3c18fd07-7717-4d10-bd49-74af3ae6ba80 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '.version_select at 0x7fcb92f09040>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:57.219305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3c18fd07-7717-4d10-bd49-74af3ae6ba80 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595886576" status: 202 len: 0 microversion: 2.1 time: 0.023412 Aug 10 12:36:57.220201 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 351/720] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 10 12:36:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595886576 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:36:57.222772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:57.230763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:57.232271 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:57.233449 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-34deb9a6-268c-4fb5-b29b-3afa72997210 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1742 microversion: 2.20 time: 0.161333 Aug 10 12:36:57.234000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 370/721] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:57 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:57.826834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3096db91-e252-4144-b54e-eba17fbf115e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'create', calling method: .version_select at 0x7fcb92d13430>, body: {"keypair": {"name": "tempest-keypair-673514588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ING7OhNiG1bbVD2Gatu1xFGLHIm7iYKt9ejvM6bFCvMxaLzzGTR00t/xESkz48syx9KN5iL2AsPhE/jWWs6pkUE9MUAcMq2tXOEdxLzUJzGckW6fZG79qw15+cLGPzA=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:57.842424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-3096db91-e252-4144-b54e-eba17fbf115e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Getting quotas for project 82c24c64f4c34921837eceb32e24a287. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:36:57.846945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-3096db91-e252-4144-b54e-eba17fbf115e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Getting quotas for user e6842565de354b0c85b04940d57c7432 and project 82c24c64f4c34921837eceb32e24a287. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:36:57.867918 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3096db91-e252-4144-b54e-eba17fbf115e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045086 Aug 10 12:36:57.868479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 352/722] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:36:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:58.136117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:58.136848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:58.143878 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:58.144362 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:58.144797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:58.145623 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:58.146117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:58.146853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:58.263089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:58.263922 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:58.270479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:58.271283 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:58.271967 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:58.273014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:58.273582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:58.274239 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:58.291855 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:58.300506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c5b90940-db74-4047-9f8a-2c880ee8b512 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.168408 Aug 10 12:36:58.301530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 371/723] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:58 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:58.494711 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:58.503226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:58.504740 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:58.505935 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-24df3de8-a9a8-4f17-b271-e9367357b843 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1742 microversion: 2.20 time: 0.248268 Aug 10 12:36:58.506500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 353/724] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:58 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1742 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:59.193537 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1687889089", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "236b8912-0b35-45fe-a06b-75541ed0e553"}], "security_groups": [{"name": "tempest-securitygroup--189156943"}], "key_name": "tempest-keypair-673514588", "user_data": "}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:36:59.293603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] validate_networks() for [('236b8912-0b35-45fe-a06b-75541ed0e553', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:36:59.322607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:59.323408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:59.330625 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:59.331114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:59.331756 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:59.332629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:59.333135 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:59.333587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:59.475425 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:59.483692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a8b15168-352f-4a22-ac55-b4b1fd874f25 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.165364 Aug 10 12:36:59.484729 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 354/725] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:59 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:36:59.528796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:59.529492 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:59.535872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:59.536345 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:59.536770 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:59.537484 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:59.537986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:59.538349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:59.669961 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:59.677932 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:59.679443 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:59.680592 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8aee74b4-ac6e-420f-b560-a1ef12c08d3f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1742 microversion: 2.20 time: 0.155645 Aug 10 12:36:59.681146 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 355/726] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:36:59 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:36:59.761136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:36:59.761590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:36:59.762070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:36:59.762484 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:36:59.762925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:36:59.771463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:59.771942 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:59.772378 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:59.773109 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:36:59.773600 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:36:59.774034 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:36:59.790111 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Getting quotas for project 82c24c64f4c34921837eceb32e24a287. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:36:59.793966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Getting quotas for user e6842565de354b0c85b04940d57c7432 and project 82c24c64f4c34921837eceb32e24a287. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:36:59.805039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:36:59.807283 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:36:59.852832 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-69b0dd05-7335-45ba-bc25-5d7a451cad08 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663626 Aug 10 12:36:59.853507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 372/727] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:36:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:36:59.864694 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ed4a01f9-6a00-482b-b567-c9b11d070794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:59.865325 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ed4a01f9-6a00-482b-b567-c9b11d070794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:36:59.916628 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ed4a01f9-6a00-482b-b567-c9b11d070794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:36:59.923807 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ed4a01f9-6a00-482b-b567-c9b11d070794 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1237 microversion: 2.1 time: 0.062860 Aug 10 12:36:59.924422 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 356/728] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:36:59 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:00.504665 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:00.505291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:00.512262 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:00.512756 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:00.513192 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:00.514117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:00.514577 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:00.515002 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:00.705355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:00.706066 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:00.712868 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:00.713506 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:00.714009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:00.714783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:00.715334 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:00.715827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:00.749877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:00.758087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f04f9065-25e6-4b4b-9c01-dcc57524d2e1 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1520 microversion: 2.1 time: 0.257789 Aug 10 12:37:00.758658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 373/729] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:00 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:00.763397 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-7fa5495c-f9f2-4ded-abfb-eecf099613fa req-7d878637-034e-440e-a1a7-ed2e7a1e6aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671", "name": "network-vif-deleted", "tag": "54d795d2-dfea-4ba7-96f1-ce5efb7da579"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:00.773237 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-7fa5495c-f9f2-4ded-abfb-eecf099613fa req-7d878637-034e-440e-a1a7-ed2e7a1e6aa4 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:00.773821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-7fa5495c-f9f2-4ded-abfb-eecf099613fa req-7d878637-034e-440e-a1a7-ed2e7a1e6aa4 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:00.774377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-7fa5495c-f9f2-4ded-abfb-eecf099613fa req-7d878637-034e-440e-a1a7-ed2e7a1e6aa4 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:00.785173 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-7fa5495c-f9f2-4ded-abfb-eecf099613fa req-7d878637-034e-440e-a1a7-ed2e7a1e6aa4 service nova] Creating event network-vif-deleted:54d795d2-dfea-4ba7-96f1-ce5efb7da579 for instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 on hv-cinder-85226 Aug 10 12:37:00.790298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-7fa5495c-f9f2-4ded-abfb-eecf099613fa req-7d878637-034e-440e-a1a7-ed2e7a1e6aa4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030270 Aug 10 12:37:00.790886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 374/730] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:00.845584 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:00.853713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:00.855158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:00.856302 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9c8f9150-8c9d-4e60-ba10-8278cca3adf4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1742 microversion: 2.20 time: 0.156520 Aug 10 12:37:00.856855 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 357/731] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:00 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:37:00.945012 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:00.945704 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:00.952126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:00.952614 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:00.953050 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:00.954408 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:00.954866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:00.955295 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:01.048202 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:01.058204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e808e530-518f-4918-9fc3-a8725b4c8d43 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1289 microversion: 2.1 time: 0.117376 Aug 10 12:37:01.077303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 375/732] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:00 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:01.324712 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-39021bd0-afb4-4743-8104-e09d13e79f5b req-316d3dbb-2c88-4909-8b42-a05df8e649ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abef27e9-175c-4101-80ee-6da94e239088", "name": "network-vif-plugged", "status": "completed", "tag": "40caaca6-10a7-43c8-8003-49d7c19f965f"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:01.335365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-39021bd0-afb4-4743-8104-e09d13e79f5b req-316d3dbb-2c88-4909-8b42-a05df8e649ed service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:01.335844 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-39021bd0-afb4-4743-8104-e09d13e79f5b req-316d3dbb-2c88-4909-8b42-a05df8e649ed service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:01.336268 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-39021bd0-afb4-4743-8104-e09d13e79f5b req-316d3dbb-2c88-4909-8b42-a05df8e649ed service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:01.348451 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-39021bd0-afb4-4743-8104-e09d13e79f5b req-316d3dbb-2c88-4909-8b42-a05df8e649ed service nova] Creating event network-vif-plugged:40caaca6-10a7-43c8-8003-49d7c19f965f for instance abef27e9-175c-4101-80ee-6da94e239088 on hv-cinder-85226 Aug 10 12:37:01.353189 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-39021bd0-afb4-4743-8104-e09d13e79f5b req-316d3dbb-2c88-4909-8b42-a05df8e649ed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092656 Aug 10 12:37:01.353812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 358/733] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:01.779434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:01.780205 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:01.786722 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:01.787203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:01.787637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:01.788332 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:01.788782 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:01.789203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:01.821387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:01.821815 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:01.822255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:01.822841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lazy-loading 'fault' on Instance uuid d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:37:01.874187 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa6d6d56f9f4618ae3883c9beb2e77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2301f937213e47c29686be4e8601ac32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:01.882700 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:01.883303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e29fae6d-be0d-4d00-b3de-955951244fa2 tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 200 len: 1311 microversion: 2.1 time: 0.107259 Aug 10 12:37:01.883510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:01.885359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 376/734] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:01 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:01.890441 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:01.890958 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:01.891390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:01.892740 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:01.893220 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:01.893662 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:02.028464 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:02.036596 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:02.038143 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:02.039327 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-88eb60ed-ecee-4ffd-a694-e77017f93089 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1742 microversion: 2.20 time: 0.162790 Aug 10 12:37:02.039882 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 359/735] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:01 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:02.084036 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:02.084573 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:02.090571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:02.091052 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:02.091485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:02.092176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:02.092626 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:02.093044 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:02.160569 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:02.167972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e7263fb8-7b68-4a1c-891d-8ae581b4cc02 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1295 microversion: 2.1 time: 0.087895 Aug 10 12:37:02.168540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 377/736] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:02 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:02.307338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1522806957", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1160807107", "security_groups": [{"name": "tempest-secgroup-smoke-1740254587"}], "block_device_mapping_v2": [{"uuid": "2daee43e-80a2-4768-9a28-316fc19d7aa1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ce24948c-b056-4a3f-868d-8498edb8d6bb"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:02.436295 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] validate_networks() for [('ce24948c-b056-4a3f-868d-8498edb8d6bb', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:37:02.864013 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:37:02.864444 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:37:02.864926 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:37:02.865383 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:37:02.865803 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:37:02.876279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:02.876787 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:02.877214 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:02.878007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:02.878466 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:02.878894 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:02.891798 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:02.899217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Getting quotas for project f63c30b5d2af4144b096b78c7ab308a7. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:37:02.904076 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:02.904682 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] [instance: d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:02.905047 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Getting quotas for user 770127af5f494b7e9198438441868fa1 and project f63c30b5d2af4144b096b78c7ab308a7. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:37:02.907633 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:02.912807 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:02.913424 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:02.913994 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:02.914791 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:02.915236 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:02.915847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:02.951469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] HTTP exception thrown: Instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 could not be found. Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Request method failure captured: Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 HTTP/1.1 Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UVCZy5cePM0_ipeKQGog--zdcGvp9RYAIh0ETNO7C_3X7o1pwdTynr0ywJx0KC7nZ4LUrhMqxiuprvTLwbCri2KCNWuuLilVY1_i-Mk6T1KxaJyBHdOkYA6xYKYWVs9Sp5sN4E6C3M9XINhC3x5-uhV528eibATDOc31y-O2lsFbU Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:37:02.954426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2301f937213e47c29686be4e8601ac32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2301f937213e47c29686be4e8601ac32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2301f937213e47c29686be4e8601ac32"}]}] Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 2301f937213e47c29686be4e8601ac32 Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-234679500 Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 2aa6d6d56f9f4618ae3883c9beb2e77b Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-ServerRescueNegativeTestJSON-234679500-project Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 could not be found. Aug 10 12:37:02.955748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'd9d0ad15-5ec9-405f-ad6d-2d0b9a2db671'} Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 could not be found. Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:02.956457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 could not be found. Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 could not be found. Aug 10 12:37:02.957627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:02.960110 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] Returning 404 to user: Instance d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:02.961168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c445ccde-812b-49e3-8489-428c46c4363f tempest-ServerRescueNegativeTestJSON-234679500 tempest-ServerRescueNegativeTestJSON-234679500-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671" status: 404 len: 111 microversion: 2.1 time: 0.061019 Aug 10 12:37:02.961934 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 378/737] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:02 2022] GET /compute/v2.1/servers/d9d0ad15-5ec9-405f-ad6d-2d0b9a2db671 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:02.988706 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:37:02.992032 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2daee43e-80a2-4768-9a28-316fc19d7aa1',volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:37:03.049347 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-0915501b-11fd-4db2-bd23-3691bbfca38c req-5ecc4b65-a909-4de3-850a-697ee1eca34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4528f4e-a5a6-4477-a906-aa36f45cb434", "tag": "a7251038-f2c2-493d-b0a5-2bfc33676b23"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:03.060061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-0915501b-11fd-4db2-bd23-3691bbfca38c req-5ecc4b65-a909-4de3-850a-697ee1eca34c service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:03.060528 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-0915501b-11fd-4db2-bd23-3691bbfca38c req-5ecc4b65-a909-4de3-850a-697ee1eca34c service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:03.061171 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-0915501b-11fd-4db2-bd23-3691bbfca38c req-5ecc4b65-a909-4de3-850a-697ee1eca34c service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:03.076740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-0915501b-11fd-4db2-bd23-3691bbfca38c req-5ecc4b65-a909-4de3-850a-697ee1eca34c service nova] Creating event network-changed:a7251038-f2c2-493d-b0a5-2bfc33676b23 for instance b4528f4e-a5a6-4477-a906-aa36f45cb434 on hv-cinder-85226 Aug 10 12:37:03.082599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-0915501b-11fd-4db2-bd23-3691bbfca38c req-5ecc4b65-a909-4de3-850a-697ee1eca34c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037287 Aug 10 12:37:03.083833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 379/738] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:03.090328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:03.091305 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:03.100850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:03.101413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:03.101902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:03.102750 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:03.103266 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:03.103738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:03.184330 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1971275b-0f9e-4bb5-a524-d8fa080452cc tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.882343 Aug 10 12:37:03.191369 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 360/739] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:37:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:37:03.196476 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:03.197345 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:03.204868 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:03.205663 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:03.206325 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:03.207239 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:03.207764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:03.208288 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:03.381949 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:03.386131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:03.391470 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-41eff530-3834-483c-8ba5-249089c1cf85 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1362 microversion: 2.1 time: 0.198188 Aug 10 12:37:03.392708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 361/740] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:03 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:03.409615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a44c9417-7eec-4fbe-bfee-2eb7e42eba5e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:03.411015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a44c9417-7eec-4fbe-bfee-2eb7e42eba5e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:03.476066 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a44c9417-7eec-4fbe-bfee-2eb7e42eba5e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:03.483685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a44c9417-7eec-4fbe-bfee-2eb7e42eba5e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1095 microversion: 2.1 time: 0.089654 Aug 10 12:37:03.497221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 362/741] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:03 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:03.726126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:03.754463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:03.760906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:03.762671 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-895b800f-76a3-44c0-a818-1fe0fd72fb3b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.677446 Aug 10 12:37:03.764519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 380/742] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:03 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:04.415588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:04.416796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:04.425065 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:04.428280 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:04.428933 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:04.429849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:04.430459 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:04.431035 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:04.504628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:04.505906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:04.516144 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:04.517798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:04.519835 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:04.521559 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:04.522464 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:04.523362 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:04.590784 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:04.603386 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6111d124-22a3-4bfa-b1aa-65b510f2ae64 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1362 microversion: 2.1 time: 0.191629 Aug 10 12:37:04.604260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 363/743] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:04 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:04.733864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:04.746454 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-baf3af0b-097d-4d5a-81e3-2b1276f61578 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1201 microversion: 2.1 time: 0.245863 Aug 10 12:37:04.747432 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 381/744] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:04 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1201 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:04.791867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:04.792942 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:04.800529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:04.801232 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:04.802225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:04.803135 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:04.803795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:04.807327 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:04.962644 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:04.975741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:04.978355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:04.978501 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-40d5861f-fed5-4d2f-854d-f6514a0c64da tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.190621 Aug 10 12:37:04.979342 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 364/745] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:04 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:05.630970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:05.632242 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:05.641694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:05.642179 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:05.642622 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:05.643345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:05.644365 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:05.646149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:05.770298 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:05.771060 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:05.780475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:05.783473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:05.784086 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:05.784923 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:05.789884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:05.792479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:06.068906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:06.081394 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3d4e1607-fa0f-47db-adc7-692aee2d4696 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1362 microversion: 2.1 time: 0.451013 Aug 10 12:37:06.082413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 382/746] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:05 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:06.093229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:06.095275 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:06.111735 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:06.112548 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:06.113154 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:06.114194 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:06.114805 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:06.115392 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:06.240542 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:06.254668 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ddd5c6cb-59ad-42e0-a4b4-f9241ce957c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1211 microversion: 2.1 time: 0.490434 Aug 10 12:37:06.258816 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 365/747] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:05 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1211 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:06.517577 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:06.530612 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:06.535764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:06.537591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e1da538b-1144-4249-a627-e7165b715495 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.453882 Aug 10 12:37:06.540784 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 383/748] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:06 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:07.103338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:07.106625 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:07.124071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:07.127888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:07.128418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:07.129167 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:07.132638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:07.133100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:07.284377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:07.289203 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:07.299551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:07.303905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:07.305438 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:07.306504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:07.309196 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:07.309972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:07.438870 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:07.452883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2d350930-c547-45af-8235-e869d942fddd tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1362 microversion: 2.1 time: 0.353659 Aug 10 12:37:07.454367 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 366/749] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:07 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:07.529323 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:07.559300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e1e60075-a788-4e71-927c-3c5190c24961 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1199 microversion: 2.1 time: 0.280970 Aug 10 12:37:07.559300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 384/750] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:07 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1199 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:07.575728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:07.576496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:07.595416 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:07.596355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:07.597072 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:07.601480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:07.602242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:07.602922 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:08.154479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:08.174043 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:08.175668 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:08.182136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c92116b7-e8fd-45fc-b7e2-306774b47863 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.615295 Aug 10 12:37:08.182807 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 367/751] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:07 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:08.478894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:08.480206 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:08.491631 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:08.492502 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:08.495136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:08.496105 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:08.497675 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:08.500898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:08.580165 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:08.581390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:08.595291 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:08.596305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:08.596932 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:08.597829 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:08.600109 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:08.601916 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:08.756724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:08.769974 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-54b6b447-e62c-46cc-b675-0782dfffb888 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1362 microversion: 2.1 time: 0.293854 Aug 10 12:37:08.772407 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 385/752] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:08 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:08.900219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-2040a987-1a3e-40d3-af24-00bf3f923100 req-c2f825df-96e6-47bc-bacf-fcded95811c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461c4836-f025-459c-9295-0a840e0e2066", "tag": "78d3316e-f954-4f65-8766-835c8e8a9708"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:08.913361 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2040a987-1a3e-40d3-af24-00bf3f923100 req-c2f825df-96e6-47bc-bacf-fcded95811c5 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:08.914584 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2040a987-1a3e-40d3-af24-00bf3f923100 req-c2f825df-96e6-47bc-bacf-fcded95811c5 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:08.915310 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-2040a987-1a3e-40d3-af24-00bf3f923100 req-c2f825df-96e6-47bc-bacf-fcded95811c5 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:08.930661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-2040a987-1a3e-40d3-af24-00bf3f923100 req-c2f825df-96e6-47bc-bacf-fcded95811c5 service nova] Creating event network-changed:78d3316e-f954-4f65-8766-835c8e8a9708 for instance 461c4836-f025-459c-9295-0a840e0e2066 on hv-cinder-85226 Aug 10 12:37:08.935912 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-2040a987-1a3e-40d3-af24-00bf3f923100 req-c2f825df-96e6-47bc-bacf-fcded95811c5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043832 Aug 10 12:37:08.937392 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 386/753] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:09.042810 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:09.057770 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bd891956-a49b-4c35-92fa-54cd4b3dffbe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.482686 Aug 10 12:37:09.058674 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 368/754] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:08 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:09.211033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:09.212029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:09.230532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:09.243107 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:09.243599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:09.244369 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:09.244849 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:09.249014 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:09.296599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-036a763b-6d9f-4653-b99b-71d2ae900edb req-dd56c5e6-1cbf-41f3-92fa-ab191b2fc33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4528f4e-a5a6-4477-a906-aa36f45cb434", "name": "network-vif-plugged", "status": "completed", "tag": "a7251038-f2c2-493d-b0a5-2bfc33676b23"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:09.319513 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-036a763b-6d9f-4653-b99b-71d2ae900edb req-dd56c5e6-1cbf-41f3-92fa-ab191b2fc33e service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:09.320015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-036a763b-6d9f-4653-b99b-71d2ae900edb req-dd56c5e6-1cbf-41f3-92fa-ab191b2fc33e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:09.322714 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-036a763b-6d9f-4653-b99b-71d2ae900edb req-dd56c5e6-1cbf-41f3-92fa-ab191b2fc33e service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:09.353361 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-036a763b-6d9f-4653-b99b-71d2ae900edb req-dd56c5e6-1cbf-41f3-92fa-ab191b2fc33e service nova] Creating event network-vif-plugged:a7251038-f2c2-493d-b0a5-2bfc33676b23 for instance b4528f4e-a5a6-4477-a906-aa36f45cb434 on hv-cinder-85226 Aug 10 12:37:09.366037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-036a763b-6d9f-4653-b99b-71d2ae900edb req-dd56c5e6-1cbf-41f3-92fa-ab191b2fc33e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073844 Aug 10 12:37:09.367017 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 369/755] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:37:09.511213 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:09.511976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:09.528293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:09.537800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:09.538494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:09.539952 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:09.541800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:09.545167 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:09.556902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:09.567676 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:09.576214 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:09.581565 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1ca8dc73-d2c0-4cd9-8285-d20f2ac8a4a1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.376110 Aug 10 12:37:09.583603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 387/756] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:09 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:09.639937 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c28af426-a28d-4c94-bf52-a816b4867126 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/ips" status: 200 len: 151 microversion: 2.1 time: 0.141143 Aug 10 12:37:09.644396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 370/757] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:37:09 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/ips => generated 151 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:37:09.792946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:09.793591 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:09.795559 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:09.802078 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=6 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:09.809677 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:09.810178 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:09.810616 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:09.811344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:09.811789 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:09.812214 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:09.846949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:10.078754 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:10.079362 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:10.087822 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:10.100272 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:10.100908 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:10.101397 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:10.102136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:10.102672 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:10.103105 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:10.103235 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-636adaad-6ea2-42cc-97e7-e16457f2fe03 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1362 microversion: 2.1 time: 0.313931 Aug 10 12:37:10.116916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 388/758] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:09 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:10.315245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:10.331721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8de000dc-8fa7-455f-a044-d65009fbcb6b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.255599 Aug 10 12:37:10.346631 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 371/759] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:10 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:10.606480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:10.607711 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:10.619863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:10.620395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:10.620814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:10.621580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:10.625869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:10.627659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:10.813651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:10.823375 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:10.826752 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:10.828141 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c6b445c5-3c4a-4ee3-9577-20f638b456b5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.227588 Aug 10 12:37:10.829116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 389/760] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:10 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:11.125170 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:11.126115 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:11.134165 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:11.135384 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:11.136007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:11.137044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:11.137701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:11.138289 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:11.271240 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6480e604-db05-4826-a262-3fbae3d92609"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:11.274254 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:11.282054 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:11.282826 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:11.283477 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:11.284642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:11.285369 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:11.286022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:11.320078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:11.330021 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7ecac2c3-0a1c-4f4d-b1fc-5a25d77070c8 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1362 microversion: 2.1 time: 0.208972 Aug 10 12:37:11.330971 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 372/761] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:11 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:11.354870 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:11.355490 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:11.363084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:11.363607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:11.364248 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:11.364755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:11.365180 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:11.365891 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:11.545468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:11.553760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-01957daa-ef79-4117-ac2f-b561129f3047 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.202560 Aug 10 12:37:11.554349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 373/762] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:11 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:11.851513 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:11.852169 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:11.862990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:11.863485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:11.864093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:11.864959 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:11.865600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:11.866355 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:12.124025 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:12.133621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:12.135634 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:12.136861 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-797bcb9a-e46a-4ce9-b6d2-bf4f9d31441e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.289216 Aug 10 12:37:12.137761 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 374/763] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:11 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:37:12.217487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-45bdadf7-0182-4883-9a5e-4df56c94618d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "POST /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.954734 Aug 10 12:37:12.219768 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 390/764] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:37:11 2022] POST /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments => generated 194 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:12.357881 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:12.359034 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:12.367524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:12.368433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:12.369023 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:12.369909 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:12.370739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:12.371317 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:12.554999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:12.564861 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4cbd07b3-3bb4-4c6b-983b-33227236d270 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1548 microversion: 2.1 time: 0.213403 Aug 10 12:37:12.566365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 375/765] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:12 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1548 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:12.575966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:12.576737 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:12.592142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:12.594604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:12.595058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:12.595630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:12.597889 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:12.598691 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:12.599352 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:12.600741 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:12.606603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:12.610612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:12.611380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:12.613971 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:12.617929 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:12.618556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:12.712824 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8032635a-e7b8-4784-92f8-de2554b49480 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124654 Aug 10 12:37:12.713908 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 376/766] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 10 12:37:12 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:12.777077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:12.789675 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-30846470-0504-4829-b564-92a61799e919 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.218347 Aug 10 12:37:12.791049 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 391/767] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:12 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:13.160252 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:13.165101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:13.165992 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:13.174260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:13.176360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:13.177506 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:13.178600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:13.179279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:13.179945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:13.455179 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:13.464180 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:13.466258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:13.467745 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9147a866-2fc3-4fe5-917e-1df4fae1c298 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.308860 Aug 10 12:37:13.482151 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 377/768] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:13 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:13.814125 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:13.815452 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:13.828721 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:13.829883 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:13.832902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:13.834634 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:13.836801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:13.837367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:14.123786 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:14.133699 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4540857f-80a3-4f6e-9e22-85c6e9fc29b5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.324775 Aug 10 12:37:14.155158 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 392/769] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:13 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:14.324393 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=14 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:14.490135 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-fa6be94f-552c-4f1e-8119-58bb2cf3b6e3 req-c6ff3b65-5827-44a2-a9d7-8219796c19f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4528f4e-a5a6-4477-a906-aa36f45cb434", "tag": "a7251038-f2c2-493d-b0a5-2bfc33676b23"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:14.494036 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:14.494648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:14.501061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:14.501596 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:14.502038 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:14.502832 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa6be94f-552c-4f1e-8119-58bb2cf3b6e3 req-c6ff3b65-5827-44a2-a9d7-8219796c19f4 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:14.502976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:14.503307 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa6be94f-552c-4f1e-8119-58bb2cf3b6e3 req-c6ff3b65-5827-44a2-a9d7-8219796c19f4 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:14.503535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:14.503734 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fa6be94f-552c-4f1e-8119-58bb2cf3b6e3 req-c6ff3b65-5827-44a2-a9d7-8219796c19f4 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:14.503961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:14.517130 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-fa6be94f-552c-4f1e-8119-58bb2cf3b6e3 req-c6ff3b65-5827-44a2-a9d7-8219796c19f4 service nova] Creating event network-changed:a7251038-f2c2-493d-b0a5-2bfc33676b23 for instance b4528f4e-a5a6-4477-a906-aa36f45cb434 on hv-cinder-85226 Aug 10 12:37:14.522792 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-fa6be94f-552c-4f1e-8119-58bb2cf3b6e3 req-c6ff3b65-5827-44a2-a9d7-8219796c19f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208835 Aug 10 12:37:14.524485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 378/770] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:37:14.741498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:14.756304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:14.758298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:14.759693 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-830a23cc-cb82-47fc-9fd8-d3268ea7e49e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.269811 Aug 10 12:37:14.775760 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 393/771] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:14 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:15.172284 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:15.173090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:15.180353 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:15.185991 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:15.190298 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:15.191991 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:15.192730 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:15.193741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:15.425459 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:15.434809 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d6a64845-f30e-4436-ab3d-233bcceb6cff tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.274878 Aug 10 12:37:15.437889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 379/772] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:15 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:15.783168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:15.784588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:15.791258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:15.791848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:15.792293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:15.793004 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:15.793501 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:15.793933 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:15.931618 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:15.940166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:15.941823 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:15.943176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9f0a4dca-94ba-44ea-9ebb-d38af2e3f3a4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.164025 Aug 10 12:37:15.943733 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 394/773] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:15 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:16.461655 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:16.462271 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:16.469102 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:16.469627 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:16.470068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:16.470764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:16.471475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:16.471904 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:16.605920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:16.613787 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e7912292-0833-4c56-865b-7477edf6cc51 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.156040 Aug 10 12:37:16.614349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 380/774] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:16 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:16.966037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:16.966641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:16.973906 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:16.974391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:16.974831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:16.975520 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:16.975976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:16.976400 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:17.103758 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:17.111644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:17.113148 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:17.114359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-24663bf5-a599-4c60-89e0-15e58edc4ed8 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.152149 Aug 10 12:37:17.114925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 395/775] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:16 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:17.633707 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:17.634322 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:17.640577 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:17.641058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:17.641532 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:17.642225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:17.642680 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:17.643103 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:17.660646 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=100 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:17.776723 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:17.784113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-93d2e8fb-23f0-452f-9950-d9edc8f4633e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.154199 Aug 10 12:37:17.784665 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 381/776] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:17 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:18.137869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:18.138420 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:18.144693 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:18.145176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:18.145643 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:18.146333 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:18.146790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:18.147217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:18.273611 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:18.282131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:18.283651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:18.284811 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ec8e5b8a-d7f8-4d8e-809b-571802450a09 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.150955 Aug 10 12:37:18.285388 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 396/777] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:18 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:18.804451 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:18.805072 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:18.811294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:18.811768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:18.812704 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:18.813412 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:18.813863 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:18.814279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:18.942523 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:18.949887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1c191c3a-0835-4d8b-a663-be92b0b2dfe9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.149229 Aug 10 12:37:18.950441 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 382/778] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:18 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:19.307544 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:19.308147 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:19.315181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:19.315687 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:19.316117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:19.316803 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:19.317253 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:19.317706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:19.454208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:19.462022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:19.463569 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:19.464733 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1c75d568-435f-4f3c-8e20-abd16e1bfa00 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1737 microversion: 2.20 time: 0.161027 Aug 10 12:37:19.465308 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 397/779] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:19 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:19.971562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:19.972082 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:19.978405 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:19.978946 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:19.979527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:19.980336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:19.980822 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:19.981452 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:20.129713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:20.137360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ef6ffee7-fb2a-4dfe-bfbe-51d4a6738854 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.170527 Aug 10 12:37:20.137961 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 383/780] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:19 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:20.488450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:20.489066 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:20.495642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:20.496149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:20.496586 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:20.497303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:20.497766 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:20.498246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:20.633741 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:20.641621 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:20.643139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:20.644356 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b5c2aa38-6c44-45ce-885f-8f1e0ca2ecc3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1719 microversion: 2.20 time: 0.160258 Aug 10 12:37:20.644852 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 398/781] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:20 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:21.010617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:21.011123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:21.017396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.017885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.018316 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.019205 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.019677 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.020099 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.107282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lazy-loading 'services' on Instance uuid d893e2b6-f8b6-4cfc-97e5-1257660aefc7 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:37:21.163631 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:21.166781 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:21.175252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.175822 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.176286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.183270 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.183967 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.184594 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.203915 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-12c1e0f0-3fbf-46b3-92d4-900374ff83aa tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments/6480e604-db05-4826-a262-3fbae3d92609" status: 202 len: 0 microversion: 2.1 time: 0.196480 Aug 10 12:37:21.204847 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 384/782] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:37:21 2022] DELETE /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments/6480e604-db05-4826-a262-3fbae3d92609 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:37:21.215143 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-f96ea930-20cd-45e0-a88d-8eff5b318997 req-646e1a0d-925b-470e-8f25-6cffa01465cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461c4836-f025-459c-9295-0a840e0e2066", "name": "network-vif-plugged", "status": "completed", "tag": "78d3316e-f954-4f65-8766-835c8e8a9708"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:21.227879 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f96ea930-20cd-45e0-a88d-8eff5b318997 req-646e1a0d-925b-470e-8f25-6cffa01465cf service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.228478 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f96ea930-20cd-45e0-a88d-8eff5b318997 req-646e1a0d-925b-470e-8f25-6cffa01465cf service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.229143 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f96ea930-20cd-45e0-a88d-8eff5b318997 req-646e1a0d-925b-470e-8f25-6cffa01465cf service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.241014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-f96ea930-20cd-45e0-a88d-8eff5b318997 req-646e1a0d-925b-470e-8f25-6cffa01465cf service nova] Creating event network-vif-plugged:78d3316e-f954-4f65-8766-835c8e8a9708 for instance 461c4836-f025-459c-9295-0a840e0e2066 on hv-cinder-85226 Aug 10 12:37:21.246221 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-f96ea930-20cd-45e0-a88d-8eff5b318997 req-646e1a0d-925b-470e-8f25-6cffa01465cf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036746 Aug 10 12:37:21.246861 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 385/783] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:21.252547 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:21.255033 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:21.263704 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.264205 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.264627 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.265898 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.266693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.267412 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.299027 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bac4e010-87de-4718-8ccf-aa5542acbdcc tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050785 Aug 10 12:37:21.299851 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 386/784] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:37:21 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:21.439740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:21.448090 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-03a717c8-75fb-4506-9bf8-d9f42edd0c38 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.292745 Aug 10 12:37:21.463506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 399/785] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:21 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:21.666486 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:21.667085 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:21.672837 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.673470 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.673852 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.674568 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:21.675183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:21.675550 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:21.807055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:21.816236 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:21.817800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:21.818985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2c6b061d-688c-44da-a0fb-77b88935e7f3 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1719 microversion: 2.20 time: 0.156337 Aug 10 12:37:21.819548 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 387/786] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:21 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:22.311347 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:22.314225 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:22.320565 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:22.321047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:22.321513 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:22.322208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:22.322662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:22.323088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:22.351930 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-aede7b35-f2f1-45ae-9efc-f46d2c9c8ed3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Aug 10 12:37:22.352482 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 400/787] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:37:22 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:22.469692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:22.470280 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:22.477045 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:22.477569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:22.478019 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:22.478716 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:22.479178 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:22.479605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:22.617485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:22.625125 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-170aea8e-223e-4e5e-81bc-fd4b3b472cac tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.159816 Aug 10 12:37:22.627719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 388/788] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:22 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:22.842970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:22.844145 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:22.850287 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:22.850763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:22.851199 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:22.851891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:22.852344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:22.852771 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:22.992964 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:23.003267 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:23.005859 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:23.007228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2ef6a715-f628-4ace-bcaa-e2812ca55fda tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1719 microversion: 2.20 time: 0.167899 Aug 10 12:37:23.012453 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 401/789] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:22 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:23.273353 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-148f4a92-2aef-4252-81f8-7ca7e0ac7094 req-0a2a53ee-fc8d-4db8-9e74-9002de992043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abef27e9-175c-4101-80ee-6da94e239088", "name": "network-vif-unplugged", "status": "completed", "tag": "40caaca6-10a7-43c8-8003-49d7c19f965f"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:23.283295 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-148f4a92-2aef-4252-81f8-7ca7e0ac7094 req-0a2a53ee-fc8d-4db8-9e74-9002de992043 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:23.283688 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-148f4a92-2aef-4252-81f8-7ca7e0ac7094 req-0a2a53ee-fc8d-4db8-9e74-9002de992043 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:23.284117 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-148f4a92-2aef-4252-81f8-7ca7e0ac7094 req-0a2a53ee-fc8d-4db8-9e74-9002de992043 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:23.294818 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-148f4a92-2aef-4252-81f8-7ca7e0ac7094 req-0a2a53ee-fc8d-4db8-9e74-9002de992043 service nova] Creating event network-vif-unplugged:40caaca6-10a7-43c8-8003-49d7c19f965f for instance abef27e9-175c-4101-80ee-6da94e239088 on hv-cinder-85226 Aug 10 12:37:23.300442 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-148f4a92-2aef-4252-81f8-7ca7e0ac7094 req-0a2a53ee-fc8d-4db8-9e74-9002de992043 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030689 Aug 10 12:37:23.301725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 389/790] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:23.364801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:23.367075 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:23.373908 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:23.374756 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:23.375505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:23.376412 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:23.377022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:23.377634 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:23.415130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-82ff028c-932b-4299-a53b-f332e9cc7dca tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054252 Aug 10 12:37:23.415693 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 402/791] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:37:23 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:23.647169 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:23.647872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:23.654287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:23.654779 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:23.655214 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:23.655973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:23.656916 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:23.657379 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:23.808562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:23.816487 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7f876ef0-70e5-48a1-9b15-f21c8ad5879c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1267 microversion: 2.1 time: 0.173955 Aug 10 12:37:23.817058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 390/792] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:23 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:24.029922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:24.030753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:24.036650 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.037070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.037571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.038267 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.038748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.039177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.174396 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:24.176688 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:24.184787 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:24.186467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:24.188304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5be3dbcb-95f8-4378-890d-e5472f1a23d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1722 microversion: 2.20 time: 0.162281 Aug 10 12:37:24.188939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 403/793] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:24 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:24.211511 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8060c3da-6fa3-4c04-afc9-a5c72fd3becd"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:24.213808 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:24.219849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.220336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.220773 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.221766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.222220 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.222642 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.428392 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:24.431605 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:24.442727 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.443285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.443751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.444699 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.445204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.445877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.484697 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a67ed1d1-2b11-42fb-aa00-d5f4d2ccfdf5 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059896 Aug 10 12:37:24.485788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 404/794] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:37:24 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 12:37:24.527348 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0a1bf908-6c2f-4cba-8f10-cb84b920d8d1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319759 Aug 10 12:37:24.528098 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 391/795] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 10 12:37:24 2022] POST /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:37:24.552823 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:24.553358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:24.559223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.559725 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.560164 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.560871 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.561354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.561787 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.587597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:37:24.677419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:24.677976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:24.684144 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.685024 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.685499 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.686359 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.686821 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.687432 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.688307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-fd62a10b-8827-48a5-8541-7e52dffaae47 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 204 len: 0 microversion: 2.1 time: 0.138778 Aug 10 12:37:24.689022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 405/796] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:37:24 2022] DELETE /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:37:24.699263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:24.700084 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:24.706276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.706942 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.707537 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.708422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.709021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.709637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.916522 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:24.924867 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-198472a4-6e94-4ea3-b6a5-6b8518a1b135 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1682 microversion: 2.1 time: 0.231324 Aug 10 12:37:24.925478 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 406/797] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:24 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:24.930163 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:24.930762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:24.938075 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.939000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.939436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:24.940133 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:24.940587 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:24.941009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:25.080860 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:25.088487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-42263cbb-bd07-4fa1-b322-38d43eb967ae tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1455 microversion: 2.1 time: 0.161844 Aug 10 12:37:25.089513 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 407/798] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:24 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:25.110169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:25.110778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:25.117053 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:25.117174 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:25.117589 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:25.118284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:25.118736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:25.119354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:25.201964 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-44a95a28-c7f6-4038-9675-8267c217f413 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "DELETE /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/os-volume_attachments/8060c3da-6fa3-4c04-afc9-a5c72fd3becd" status: 202 len: 0 microversion: 2.20 time: 0.530190 Aug 10 12:37:25.202550 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 392/799] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 10 12:37:24 2022] DELETE /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/os-volume_attachments/8060c3da-6fa3-4c04-afc9-a5c72fd3becd => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 12:37:25.261610 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:25.270446 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-99e9a79c-b894-4f16-a02a-ac103ab2ea54 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1455 microversion: 2.1 time: 0.164426 Aug 10 12:37:25.271182 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 408/800] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:25 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:25.274095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:25.274681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:25.281691 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:25.282246 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:25.282599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:25.283285 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:25.283732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:25.284145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:25.314280 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118381) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 12:37:25.339389 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=6,nova_cell1:UPDATE=8 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:25.389227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8b4940e3-da5a-489e-87c7-fb754e9471b1 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "POST /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/action" status: 202 len: 0 microversion: 2.20 time: 0.118610 Aug 10 12:37:25.394727 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 393/801] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 10 12:37:25 2022] POST /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 12:37:25.404132 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:25.404132 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:25.407259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:25.407753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:25.408190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:25.408891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:25.409381 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:25.410046 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:25.627678 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:25.643267 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:25.644825 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:25.646084 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c8107541-4018-4a79-a2c0-3c7f98de065e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1670 microversion: 2.20 time: 0.250374 Aug 10 12:37:25.647032 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 409/802] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:25 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:25.946972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:25.947585 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:25.955573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:25.956068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:25.956499 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:25.957395 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:25.958009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:25.958580 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:26.215418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:26.223640 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-60d04404-1e32-48cf-b17a-32de713582a4 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1682 microversion: 2.1 time: 0.281564 Aug 10 12:37:26.224259 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 394/803] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:25 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1682 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:26.670400 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:26.671008 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:26.678370 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:26.678853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:26.679291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:26.680017 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:26.680471 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:26.680896 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:26.833146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:26.841833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:26.843553 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:26.844738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1dc53607-af1a-48ea-985e-e533f3d316c2 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1670 microversion: 2.20 time: 0.178129 Aug 10 12:37:26.845286 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 410/804] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:26 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:27.247785 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:27.248401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:27.261962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:27.262870 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:27.263748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:27.264741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:27.265661 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:27.266431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:27.452696 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-6fd5908b-0f9f-4133-ab26-c0696fa7eea5 req-1e1fdca9-95ca-461a-956d-23a65f75ff66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461c4836-f025-459c-9295-0a840e0e2066", "tag": "78d3316e-f954-4f65-8766-835c8e8a9708"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:27.466465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6fd5908b-0f9f-4133-ab26-c0696fa7eea5 req-1e1fdca9-95ca-461a-956d-23a65f75ff66 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:27.467472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6fd5908b-0f9f-4133-ab26-c0696fa7eea5 req-1e1fdca9-95ca-461a-956d-23a65f75ff66 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:27.468031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6fd5908b-0f9f-4133-ab26-c0696fa7eea5 req-1e1fdca9-95ca-461a-956d-23a65f75ff66 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:27.485468 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-6fd5908b-0f9f-4133-ab26-c0696fa7eea5 req-1e1fdca9-95ca-461a-956d-23a65f75ff66 service nova] Creating event network-changed:78d3316e-f954-4f65-8766-835c8e8a9708 for instance 461c4836-f025-459c-9295-0a840e0e2066 on hv-cinder-85226 Aug 10 12:37:27.493117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-6fd5908b-0f9f-4133-ab26-c0696fa7eea5 req-1e1fdca9-95ca-461a-956d-23a65f75ff66 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043767 Aug 10 12:37:27.494375 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 411/805] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:27.495068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:27.505514 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-33bac35c-b2f9-447b-88cf-e3fcf0ca567b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1682 microversion: 2.1 time: 0.262786 Aug 10 12:37:27.508722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 395/806] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:27 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:27.867383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:27.868621 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:27.875616 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:27.876331 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:27.876921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:27.877805 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:27.878746 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:27.879848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:28.209939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:28.217990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:28.220306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:28.221970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cab6cd71-a227-4475-932b-c9e1d80f2841 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.358912 Aug 10 12:37:28.222708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 412/807] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:27 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:28.526960 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:28.528179 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:28.535326 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:28.535987 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:28.536431 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:28.537149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:28.537656 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:28.538085 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:28.602161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8e4aad09814f8299a334639e34d948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bbb137a895941b1876eebfc56c28425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:28.609692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ce3b7e30-b24a-4fdc-aa72-b6697bde1aeb tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 200 len: 1615 microversion: 2.1 time: 0.086751 Aug 10 12:37:28.610488 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 396/808] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:28 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:28.756629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-123f334a-4399-4df5-aea8-ad834b8875e8 req-8f6d488e-37c4-4add-b7fc-f0b6a78cd2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d893e2b6-f8b6-4cfc-97e5-1257660aefc7", "name": "network-vif-deleted", "tag": "3e9aa74e-4b3e-4476-9906-4d960251eeee"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:28.774498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-123f334a-4399-4df5-aea8-ad834b8875e8 req-8f6d488e-37c4-4add-b7fc-f0b6a78cd2a3 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:28.775519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-123f334a-4399-4df5-aea8-ad834b8875e8 req-8f6d488e-37c4-4add-b7fc-f0b6a78cd2a3 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:28.776116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-123f334a-4399-4df5-aea8-ad834b8875e8 req-8f6d488e-37c4-4add-b7fc-f0b6a78cd2a3 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:28.801605 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-123f334a-4399-4df5-aea8-ad834b8875e8 req-8f6d488e-37c4-4add-b7fc-f0b6a78cd2a3 service nova] Creating event network-vif-deleted:3e9aa74e-4b3e-4476-9906-4d960251eeee for instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 on hv-cinder-85226 Aug 10 12:37:28.810093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-123f334a-4399-4df5-aea8-ad834b8875e8 req-8f6d488e-37c4-4add-b7fc-f0b6a78cd2a3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056897 Aug 10 12:37:28.811274 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 413/809] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:29.246105 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:29.246720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:29.254789 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:29.255302 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:29.256162 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:29.256603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:29.257254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:29.257715 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:29.417905 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:29.431994 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:29.433678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:29.435612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-25698e70-d5b1-494a-b790-9ee970912430 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.192812 Aug 10 12:37:29.436254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 397/810] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:29 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:29.633236 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:29.633980 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:29.649646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:29.650413 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:29.652451 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:29.653676 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:29.654648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:29.655205 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:29.675848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 HTTP/1.1 Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:37:29.677949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:29.679669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'd893e2b6-f8b6-4cfc-97e5-1257660aefc7'} Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:29.680601 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:29.683973 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:29.686040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:29.686040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cad9b1dc-70e5-4d3a-93e3-a1991f469889 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 404 len: 111 microversion: 2.1 time: 0.052934 Aug 10 12:37:29.686040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 414/811] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:29 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:29.690777 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ecee863e-3ca1-43f7-b5d8-d54b1c9197ec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '.version_select at 0x7fcb92cef8b0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:29.716966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ecee863e-3ca1-43f7-b5d8-d54b1c9197ec tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950414656" status: 202 len: 0 microversion: 2.1 time: 0.030240 Aug 10 12:37:29.719417 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 398/812] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 10 12:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950414656 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:37:30.463866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:30.465350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:30.476183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:30.477193 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:30.478423 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:30.479996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:30.481047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:30.482587 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:30.806636 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:30.816474 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:30.822682 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:30.825160 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3c10d458-297c-40db-bd56-c06c667285ab tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.368134 Aug 10 12:37:30.825774 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 415/813] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:30 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:31.849057 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:31.849698 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:31.859910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:31.860416 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:31.860925 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:31.861756 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:31.862289 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:31.862795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:32.009722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:32.019780 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:32.021839 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:32.023242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-747dd300-1ff7-40a5-882b-2d9b6470c19f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.179079 Aug 10 12:37:32.023895 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 399/814] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:31 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:37:32.131976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:32.133157 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:32.140503 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:32.141765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:32.142519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:32.143461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:32.144156 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:32.144909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:32.160056 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: DELETE /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 HTTP/1.1 Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:37:32.161780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.163136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'd893e2b6-f8b6-4cfc-97e5-1257660aefc7'} Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:32.163862 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.165096 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.166355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:32.166355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7f887c14-2e1f-4255-928b-0e57c45e61dd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 404 len: 111 microversion: 2.1 time: 0.035497 Aug 10 12:37:32.166355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 416/815] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:37:32 2022] DELETE /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:32.172225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:32.172843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: d893e2b6-f8b6-4cfc-97e5-1257660aefc7] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:32.178624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:32.179113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:32.179574 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:32.180251 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:32.180711 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:32.181137 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:32.195027 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 HTTP/1.1 Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:37:32.197234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.198602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'd893e2b6-f8b6-4cfc-97e5-1257660aefc7'} Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:32.199329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. Aug 10 12:37:32.200748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:32.201896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance d893e2b6-f8b6-4cfc-97e5-1257660aefc7 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:32.201896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3fa8d686-603b-4696-9bd2-9e97f06a53fd tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7" status: 404 len: 111 microversion: 2.1 time: 0.031127 Aug 10 12:37:32.201896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 400/816] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:32 2022] GET /compute/v2.1/servers/d893e2b6-f8b6-4cfc-97e5-1257660aefc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:33.046226 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:33.047151 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:33.053885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.054377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.054960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.055666 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.056316 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.056754 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.227896 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:33.236684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:33.238245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:33.239459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4c7c65d3-9362-45d8-9211-637dc6ec3117 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.197110 Aug 10 12:37:33.240330 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 417/817] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:33 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:33.391044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:33.391761 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:33.394882 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:33.407878 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.408389 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.408889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.425319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.425319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.425319 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.452626 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 HTTP/1.1 Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:37:33.454598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.456000 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88'} Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:33.456728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.458154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.459500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:33.459500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-28c27c6b-8a83-4715-a718-5a243dace5a2 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 404 len: 111 microversion: 2.1 time: 0.069281 Aug 10 12:37:33.459500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 401/818] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:37:33 2022] DELETE /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:33.464920 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:33.465566 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:33.476183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:33.477861 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.478555 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.479499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.481366 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.481366 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.481366 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.505907 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 HTTP/1.1 Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:37:33.507649 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.509779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88'} Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:33.513798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. Aug 10 12:37:33.515430 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.516790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:33.516790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d884b4a4-31c7-4d74-b57a-6186a0dbbd1d tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88" status: 404 len: 111 microversion: 2.1 time: 0.048391 Aug 10 12:37:33.516790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 418/819] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:33 2022] GET /compute/v2.1/servers/3d8c3a1b-26a8-42cf-b6c1-9315ea0e4e88 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:33.525674 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:33.526190 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:33.533374 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.533868 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.534307 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.535022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.535493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.535933 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.551388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 HTTP/1.1 Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:37:33.553494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.555046 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '6264d236-8e5e-4e84-818f-10b9a8c54235'} Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:33.555972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.557390 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.558825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:33.558825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-151650cb-2e1a-4426-ba44-2120c5c48fd3 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 404 len: 111 microversion: 2.1 time: 0.034714 Aug 10 12:37:33.558825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 402/820] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:37:33 2022] DELETE /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:33.565820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:33.574679 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 6264d236-8e5e-4e84-818f-10b9a8c54235] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:33.581831 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.582414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.582931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.583718 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:33.584255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:33.584900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:33.606903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 HTTP/1.1 Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:37:33.608479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.610827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '6264d236-8e5e-4e84-818f-10b9a8c54235'} Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:33.611847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. Aug 10 12:37:33.613639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:33.615027 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 6264d236-8e5e-4e84-818f-10b9a8c54235 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:33.615027 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c8ce3bab-af3c-46ae-b2b8-0b787ee2d275 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235" status: 404 len: 111 microversion: 2.1 time: 0.050202 Aug 10 12:37:33.624013 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 419/821] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:33 2022] GET /compute/v2.1/servers/6264d236-8e5e-4e84-818f-10b9a8c54235 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 12:37:34.268364 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:34.270158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:34.277845 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:34.278458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:34.278900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:34.279616 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:34.280075 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:34.280503 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:34.451236 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:34.461410 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:34.463148 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:34.464320 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a3ec7044-8b11-4dab-907f-35f1caef7782 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.204740 Aug 10 12:37:34.465037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 403/822] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:34 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:34.790198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:34.793850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:34.808850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:34.809403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:34.810169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:34.811154 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:34.812639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:34.813338 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:34.834866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: DELETE /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a HTTP/1.1 Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:37:34.836821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.838644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '7e6bf86e-2553-4f1c-8620-92c63510184a'} Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:34.839806 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.841869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.843291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:34.843291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-31a79557-0462-4cdd-b191-387eebd9670b tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 404 len: 111 microversion: 2.1 time: 0.057467 Aug 10 12:37:34.843291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 420/823] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:37:34 2022] DELETE /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:34.847428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:34.848232 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] [instance: 7e6bf86e-2553-4f1c-8620-92c63510184a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:34.855426 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:34.856232 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:34.856800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:34.857617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:34.858226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:34.858665 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:34.876695 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] HTTP exception thrown: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Request method failure captured: Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a HTTP/1.1 Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UT2aFATxTQYwin85eYFhFbQ4NMCMjuu1isIFFvGSrFobKd1IaZNR7-A7aG4QNLNf-aD8eIji9oJI3cAIA2Xx3YDIYpwX85aL8nLbloT4Iv6BOh3Z-VqkTEwgkM1ms-G7WlXi5t_Z_Lk7ocUrPVPKwRKWoT8J7PEacFYizJmBRZ0G4 Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:37:34.878428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0bbb137a895941b1876eebfc56c28425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0bbb137a895941b1876eebfc56c28425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0bbb137a895941b1876eebfc56c28425"}]}] Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 0bbb137a895941b1876eebfc56c28425 Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1356864288 Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9b8e4aad09814f8299a334639e34d948 Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeNegativeTest-1356864288-project Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.884493 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '7e6bf86e-2553-4f1c-8620-92c63510184a'} Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:37:34.885997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. Aug 10 12:37:34.887381 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:37:34.888546 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] Returning 404 to user: Instance 7e6bf86e-2553-4f1c-8620-92c63510184a could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:37:34.888546 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8ede1514-158f-47d2-839b-bf2ec3182cb6 tempest-AttachVolumeNegativeTest-1356864288 tempest-AttachVolumeNegativeTest-1356864288-project] 10.222.0.65 "GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a" status: 404 len: 111 microversion: 2.1 time: 0.036738 Aug 10 12:37:34.888546 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 404/824] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:34 2022] GET /compute/v2.1/servers/7e6bf86e-2553-4f1c-8620-92c63510184a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:37:35.488545 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:35.489161 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:35.495138 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:35.495620 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:35.496058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:35.496749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:35.497208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:35.497661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:35.711864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:35.722104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:35.724476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:35.726122 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4d28b661-ec27-4253-aa01-fbad9cf4a327 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.242041 Aug 10 12:37:35.727228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 421/825] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:35 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:36.751492 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:36.752966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:36.775071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:36.776800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:36.778393 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:36.779143 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:36.779599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:36.782045 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:37.594874 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:37.610702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:37.612350 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:37.613670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9b495d88-5664-4a90-814a-a71776fa879b tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.866786 Aug 10 12:37:37.619521 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 405/826] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:36 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:38.637592 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:38.638180 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:38.647447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:38.648213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:38.648354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:38.649053 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:38.649595 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:38.650009 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:38.896568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:38.907857 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:38.909580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:38.911202 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-068d61e7-b786-4e76-b087-51bd7f175247 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.277441 Aug 10 12:37:38.959382 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 422/827] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:38 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:39.936516 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:39.937953 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:39.945575 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:39.946063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:39.946634 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:39.947350 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:39.948071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:39.948597 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:40.131210 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:40.139837 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:40.141518 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:40.142887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1dece851-4e36-4b0a-a232-90309b53c1a7 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.210825 Aug 10 12:37:40.143432 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 406/828] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:39 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:41.169761 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:41.170529 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:41.179067 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:41.179561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:41.180204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:41.181002 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:41.181654 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:41.182218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:41.201040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:41.340312 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:41.351587 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:41.353054 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:41.354279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b9e38b1d-2d2c-4e94-9953-c74d9fa9a371 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.192281 Aug 10 12:37:41.355133 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 423/829] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:41 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:42.379241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:42.379844 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:42.386131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:42.386608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:42.387037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:42.387720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:42.388170 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:42.388615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:42.526211 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:42.534778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:42.536174 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:42.537362 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-70ddc1fe-c7ae-4287-b9a8-80c152705e9e tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.162755 Aug 10 12:37:42.537911 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 407/830] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:42 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:42.558918 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1930260582", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:42.612491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] validate_networks() for None {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:37:43.147653 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:37:43.148104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:37:43.148580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:37:43.149065 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:37:43.149514 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:37:43.158891 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:43.159608 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:43.160053 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:43.160788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:43.161250 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:43.161712 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:43.178276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Getting quotas for project 22729064206f44009207e22ade61deda. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:37:43.182226 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Getting quotas for user 5a8ddc5f3f844f1984f0b1e188d3662a and project 22729064206f44009207e22ade61deda. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:37:43.193377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:37:43.195645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:37:43.227073 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-c4006457-4fc3-4733-886d-9c25fc3c6301 req-5d2cd62e-a2bb-40f1-a708-4063c190ef61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abef27e9-175c-4101-80ee-6da94e239088", "name": "network-vif-plugged", "status": "completed", "tag": "40caaca6-10a7-43c8-8003-49d7c19f965f"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:43.238721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c4006457-4fc3-4733-886d-9c25fc3c6301 req-5d2cd62e-a2bb-40f1-a708-4063c190ef61 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:43.240491 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c4006457-4fc3-4733-886d-9c25fc3c6301 req-5d2cd62e-a2bb-40f1-a708-4063c190ef61 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:43.241003 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-c4006457-4fc3-4733-886d-9c25fc3c6301 req-5d2cd62e-a2bb-40f1-a708-4063c190ef61 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:43.242224 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-08474b2a-f1b6-41fc-adb2-fa5c6ecd81c4 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687162 Aug 10 12:37:43.243364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 424/831] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:37:43.253745 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-c4006457-4fc3-4733-886d-9c25fc3c6301 req-5d2cd62e-a2bb-40f1-a708-4063c190ef61 service nova] Creating event network-vif-plugged:40caaca6-10a7-43c8-8003-49d7c19f965f for instance abef27e9-175c-4101-80ee-6da94e239088 on hv-cinder-85226 Aug 10 12:37:43.254371 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3fb2c50f-e653-480e-9f39-a11e97da2d32 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:43.254983 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3fb2c50f-e653-480e-9f39-a11e97da2d32 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:43.260594 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-c4006457-4fc3-4733-886d-9c25fc3c6301 req-5d2cd62e-a2bb-40f1-a708-4063c190ef61 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037516 Aug 10 12:37:43.262109 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 408/832] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:37:43.333398 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3fb2c50f-e653-480e-9f39-a11e97da2d32 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:43.340480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3fb2c50f-e653-480e-9f39-a11e97da2d32 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1215 microversion: 2.1 time: 0.090427 Aug 10 12:37:43.341241 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 425/833] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:43 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:43.566404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:43.567127 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:43.574591 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:43.574999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:43.575457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:43.576348 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:43.576799 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:43.577504 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:43.712136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:43.720111 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:43.721922 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:43.723079 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e453d2f0-8b00-4cf7-8c8e-59435a16cb62 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.162197 Aug 10 12:37:43.723634 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 409/834] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:43 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:44.361644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:44.362262 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:44.368654 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:44.369146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:44.369628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:44.370330 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:44.370794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:44.371224 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:44.435068 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:44.442558 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-bc7d3774-5380-47b6-bdc1-5af409e98154 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1211 microversion: 2.1 time: 0.085385 Aug 10 12:37:44.443132 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 426/835] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:44 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:44.746103 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:44.746712 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:44.753177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:44.753699 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:44.754138 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:44.754827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:44.755285 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:44.755712 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:44.880201 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:44.887979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:44.889519 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:44.891290 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-12bf3111-0a3f-4be1-9644-88e9638b30ef tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.149144 Aug 10 12:37:44.891842 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 410/836] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:44 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:45.463389 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:45.463925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:45.470268 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:45.470748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:45.471440 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:45.472213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:45.472668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:45.473088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:45.532866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:45.540221 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5fe45cbd-db25-4a87-923e-74adc2d39691 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1267 microversion: 2.1 time: 0.080718 Aug 10 12:37:45.540779 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 427/837] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:45 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:45.915198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:45.915806 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:45.922819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:45.923306 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:45.923743 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:45.924433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:45.924893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:45.925349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:46.052920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:46.061408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:46.063242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:46.064507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f629e154-8869-4f11-b4c6-22164f41e919 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.153276 Aug 10 12:37:46.065056 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 411/838] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:45 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:46.560530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:46.561083 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:46.568005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:46.568491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:46.568926 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:46.569640 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:46.570095 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:46.570517 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:46.635416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:46.643348 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7ffe2976-e7fb-4151-b6df-5d6af61b3b77 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1267 microversion: 2.1 time: 0.086745 Aug 10 12:37:46.643912 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 428/839] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:46 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:47.087567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:47.088177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:47.095017 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:47.095496 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:47.096203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:47.096903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:47.097369 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:47.097792 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:47.223909 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:47.231846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:47.233374 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:47.235114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-551bbadc-2a49-4c19-95e4-05ad21995712 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1728 microversion: 2.20 time: 0.151472 Aug 10 12:37:47.235650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 412/840] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:47 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:37:47.663865 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:47.664620 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:47.670755 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:47.671241 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:47.671673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:47.672357 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:47.672866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:47.673212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:47.735359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:47.743042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ae3cd9c1-13cb-4133-bc97-f7f2bdf52c14 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1275 microversion: 2.1 time: 0.082917 Aug 10 12:37:47.743620 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 429/841] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:47 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:48.258697 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:48.259357 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:48.266649 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:48.267153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:48.267761 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:48.268481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:48.268941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:48.269617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:48.426454 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:48.428724 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:48.437421 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:48.438952 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:48.440114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c0bff749-6f41-47ce-9f3b-769c4e50d8ed tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1715 microversion: 2.20 time: 0.186156 Aug 10 12:37:48.440697 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 413/842] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:37:48 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1715 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:37:48.764626 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:48.765931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:48.777175 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:48.777810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:48.778255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:48.779021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:48.779658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:48.780249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:48.873521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:48.880427 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c941b286-e2f2-4e22-8bdf-6ba1343fcdb8 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1273 microversion: 2.1 time: 0.120271 Aug 10 12:37:48.881233 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 430/843] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:48 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:49.721785 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-f5a521bb-d7d8-49bb-aa1c-8eb6d1ced89f req-6607e9dc-12da-4c73-a83f-fd09e9a465b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7824427-8117-4fc9-b668-d59377232f84", "tag": "59231bba-0dfb-4095-995f-6e99537c156f"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:49.734198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f5a521bb-d7d8-49bb-aa1c-8eb6d1ced89f req-6607e9dc-12da-4c73-a83f-fd09e9a465b2 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:49.734938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f5a521bb-d7d8-49bb-aa1c-8eb6d1ced89f req-6607e9dc-12da-4c73-a83f-fd09e9a465b2 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:49.735363 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f5a521bb-d7d8-49bb-aa1c-8eb6d1ced89f req-6607e9dc-12da-4c73-a83f-fd09e9a465b2 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:49.746125 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-f5a521bb-d7d8-49bb-aa1c-8eb6d1ced89f req-6607e9dc-12da-4c73-a83f-fd09e9a465b2 service nova] Creating event network-changed:59231bba-0dfb-4095-995f-6e99537c156f for instance c7824427-8117-4fc9-b668-d59377232f84 on hv-cinder-85226 Aug 10 12:37:49.751322 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-f5a521bb-d7d8-49bb-aa1c-8eb6d1ced89f req-6607e9dc-12da-4c73-a83f-fd09e9a465b2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033596 Aug 10 12:37:49.751896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 414/844] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:37:49.901694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:49.902338 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:49.908666 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:49.909149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:49.909628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:49.910359 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:49.910812 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:49.911238 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:50.124434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:50.132450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2a9aff41-c4f7-4057-aa56-2267891016d3 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1315 microversion: 2.1 time: 0.234504 Aug 10 12:37:50.133304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 431/845] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:49 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:51.154401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:51.155019 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:51.161075 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:51.161578 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:51.162012 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:51.162692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:51.163142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:51.163562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:51.288052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:51.295373 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7f3ca717-43b0-403c-a34e-411c1ec67120 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1315 microversion: 2.1 time: 0.145742 Aug 10 12:37:51.296412 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 415/846] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:51 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:52.317026 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:52.317672 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:52.324089 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:52.324574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:52.325011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:52.325737 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:52.326195 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:52.326658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:52.455372 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:52.462690 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d8b364e4-ae91-44e2-96e0-a1ef4ad5d696 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1315 microversion: 2.1 time: 0.149511 Aug 10 12:37:52.463252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 432/847] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:52 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:53.483562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:53.484103 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:53.490522 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:53.491002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:53.491432 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:53.492113 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:53.492561 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:53.492979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:53.626275 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:53.633748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c31b65d8-7ee7-4e64-8164-2b75bba3486a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1315 microversion: 2.1 time: 0.154164 Aug 10 12:37:53.634314 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 416/848] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:53 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:54.654890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:54.655994 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:54.657883 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:54.658677 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=8 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:37:54.664128 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:54.664611 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:54.665049 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:54.665780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:54.666243 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:54.666668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:54.795306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:54.803315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-04fe0cc6-6953-4208-8ec3-7333db3f4f80 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1315 microversion: 2.1 time: 0.152461 Aug 10 12:37:54.803883 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 433/849] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:54 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:55.271774 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-a1396487-49e4-4822-9c52-8fd72c874e49 req-d6c316e9-72ba-4849-a837-5e84d43424f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7824427-8117-4fc9-b668-d59377232f84", "name": "network-vif-plugged", "status": "completed", "tag": "59231bba-0dfb-4095-995f-6e99537c156f"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:55.283061 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-a1396487-49e4-4822-9c52-8fd72c874e49 req-d6c316e9-72ba-4849-a837-5e84d43424f2 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:55.283543 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-a1396487-49e4-4822-9c52-8fd72c874e49 req-d6c316e9-72ba-4849-a837-5e84d43424f2 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:55.284100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-a1396487-49e4-4822-9c52-8fd72c874e49 req-d6c316e9-72ba-4849-a837-5e84d43424f2 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:55.295546 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-a1396487-49e4-4822-9c52-8fd72c874e49 req-d6c316e9-72ba-4849-a837-5e84d43424f2 service nova] Creating event network-vif-plugged:59231bba-0dfb-4095-995f-6e99537c156f for instance c7824427-8117-4fc9-b668-d59377232f84 on hv-cinder-85226 Aug 10 12:37:55.300348 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-a1396487-49e4-4822-9c52-8fd72c874e49 req-d6c316e9-72ba-4849-a837-5e84d43424f2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032328 Aug 10 12:37:55.300938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 417/850] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:37:55.823867 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:55.824450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:55.830847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:55.831335 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:55.831771 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:55.832461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:55.832918 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:55.833370 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:55.961606 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:55.969064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2e548fd3-50c5-4100-b581-e4f89687368a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1315 microversion: 2.1 time: 0.149124 Aug 10 12:37:55.969776 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 434/851] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:55 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:56.991326 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:56.992051 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:56.998148 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:56.998628 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:56.999567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:57.000256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:57.000713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:57.001138 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:57.128156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:57.135630 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-085120a9-3e51-46fe-9e8b-98697d13bb6a tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1315 microversion: 2.1 time: 0.149019 Aug 10 12:37:57.136191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 418/852] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:56 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:58.156458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:58.157099 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:58.163484 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:58.163957 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:58.164595 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:58.165313 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:58.165778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:58.166204 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:58.287904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:58.299284 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:58.302487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:58.306738 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9e7b2c9a-dc5b-47da-8e65-a47876f2c13e tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1465 microversion: 2.1 time: 0.154807 Aug 10 12:37:58.307388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 419/853] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:58 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:37:58.308978 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:58.309495 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:58.309931 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:58.310631 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:58.311082 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:58.312059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:58.335689 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d4b03e25-84e5-4548-9348-3bf542617bb0 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/ips" status: 200 len: 146 microversion: 2.1 time: 0.219448 Aug 10 12:37:58.336239 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 435/854] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:37:58 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/ips => generated 146 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:37:58.351778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:58.352462 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:58.358703 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:58.359197 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:58.359636 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:58.360335 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:58.360795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:58.361223 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:58.385747 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:37:58.466592 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b550d8cf-c14c-49f4-8add-d8bb000b2dbb tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 204 len: 0 microversion: 2.1 time: 0.117311 Aug 10 12:37:58.467756 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 420/855] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:37:58 2022] DELETE /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:37:58.475894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:58.476504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:58.482558 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:58.483052 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:58.483521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:58.484185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:58.484645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:58.485069 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:58.638599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:58.647935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2dd0080f-9248-4620-9ec7-b81e4f42b598 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1471 microversion: 2.1 time: 0.175783 Aug 10 12:37:58.648695 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 436/856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:58 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:37:59.669963 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:37:59.670693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:59.677288 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:59.677790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:59.678227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:59.678928 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:59.679389 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:59.679820 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:59.682151 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bae4107c-5b73-4c1d-b6b5-443ffebf84dc"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:37:59.684603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:37:59.690923 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:59.691405 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:59.691841 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:59.692534 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:37:59.692988 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:37:59.693440 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:37:59.815978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:37:59.823424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4dde314f-14f7-40f3-8e5b-b71595d34966 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1471 microversion: 2.1 time: 0.157835 Aug 10 12:37:59.823989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 421/857] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:37:59 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:00.212112 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-42b47e3f-1b2b-4064-bcb8-dea9c9ebd2db tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533839 Aug 10 12:38:00.212749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 437/858] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:37:59 2022] POST /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:38:00.846364 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:00.846997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:00.853287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:00.853780 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:00.854215 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:00.854910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:00.855364 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:00.855786 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:00.917800 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8ddc5f3f844f1984f0b1e188d3662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22729064206f44009207e22ade61deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:00.931963 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-674582f3-c6ae-4ef4-a819-f102a0a0f776 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 200 len: 1429 microversion: 2.1 time: 0.090143 Aug 10 12:38:00.932673 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 422/859] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:00 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:00.982580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-379c55e9-8e9b-453a-a700-a3b28def2020 req-bc428ffe-f147-4481-a73f-f97130b0b968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7824427-8117-4fc9-b668-d59377232f84", "name": "network-vif-deleted", "tag": "59231bba-0dfb-4095-995f-6e99537c156f"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:00.992998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-379c55e9-8e9b-453a-a700-a3b28def2020 req-bc428ffe-f147-4481-a73f-f97130b0b968 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:00.993529 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-379c55e9-8e9b-453a-a700-a3b28def2020 req-bc428ffe-f147-4481-a73f-f97130b0b968 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:00.993970 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-379c55e9-8e9b-453a-a700-a3b28def2020 req-bc428ffe-f147-4481-a73f-f97130b0b968 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:01.005688 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-379c55e9-8e9b-453a-a700-a3b28def2020 req-bc428ffe-f147-4481-a73f-f97130b0b968 service nova] Creating event network-vif-deleted:59231bba-0dfb-4095-995f-6e99537c156f for instance c7824427-8117-4fc9-b668-d59377232f84 on hv-cinder-85226 Aug 10 12:38:01.010447 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-379c55e9-8e9b-453a-a700-a3b28def2020 req-bc428ffe-f147-4481-a73f-f97130b0b968 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032419 Aug 10 12:38:01.013981 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 438/860] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:01.953982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:01.954598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] [instance: c7824427-8117-4fc9-b668-d59377232f84] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:01.960702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:01.961184 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:01.961659 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:01.962351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:01.962809 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:01.963234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:01.976368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] HTTP exception thrown: Instance c7824427-8117-4fc9-b668-d59377232f84 could not be found. Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Request method failure captured: Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 HTTP/1.1 Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86aUz1oXl_UAEAg8oTBr3jX2w-FScUDl5M5Q6F4ho2Owz5C3Gmx3ax5QLXh0o1AQi7hQOXY_xCaqjT6wCKUTU1qKryAX-lJHdncUkQvPD3w1Mg5D_M956qgGG8sxMmfkTeEFQgGovRaxByP32DxbZOzKmiLr1ZSQb0YB58121SQVvKw Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 22729064206f44009207e22ade61deda Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesNegativeTest-145203340 Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:01.978022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22729064206f44009207e22ade61deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_22729064206f44009207e22ade61deda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/22729064206f44009207e22ade61deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22729064206f44009207e22ade61deda"}]}] Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesNegativeTest-145203340 Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 22729064206f44009207e22ade61deda Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesNegativeTest-145203340 Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesNegativeTest-145203340-project Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 5a8ddc5f3f844f1984f0b1e188d3662a Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesNegativeTest-145203340-project Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance c7824427-8117-4fc9-b668-d59377232f84 could not be found. Aug 10 12:38:01.979599 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'c7824427-8117-4fc9-b668-d59377232f84'} Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7824427-8117-4fc9-b668-d59377232f84 could not be found. Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:01.980559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7824427-8117-4fc9-b668-d59377232f84 could not be found. Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7824427-8117-4fc9-b668-d59377232f84 could not be found. Aug 10 12:38:01.982077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:01.983890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] Returning 404 to user: Instance c7824427-8117-4fc9-b668-d59377232f84 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:01.983890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-561a66df-5495-4c0a-9128-008c1ffa2601 tempest-VolumesNegativeTest-145203340 tempest-VolumesNegativeTest-145203340-project] 10.222.0.65 "GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84" status: 404 len: 111 microversion: 2.1 time: 0.029315 Aug 10 12:38:01.983890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 423/861] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:01 2022] GET /compute/v2.1/servers/c7824427-8117-4fc9-b668-d59377232f84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:38:10.922140 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:10.924355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:10.926308 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:10.931638 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:10.932126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:10.932564 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:10.933283 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:10.933746 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:10.934172 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:10.964097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a73bb7a6-b686-405f-af4b-105cbb35dff4 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046939 Aug 10 12:38:10.964654 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 439/862] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:38:10 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:38:10.976458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:10.976939 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:10.979600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:10.984954 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:10.985470 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:10.985908 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:10.986608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:10.987064 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:10.987489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:11.017009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cdd82472-59bd-4474-95ee-8d3d49383f8c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/bae4107c-5b73-4c1d-b6b5-443ffebf84dc" status: 200 len: 194 microversion: 2.1 time: 0.044408 Aug 10 12:38:11.017623 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 424/863] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 10 12:38:10 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/bae4107c-5b73-4c1d-b6b5-443ffebf84dc => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:12.366921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9da28e07-b924-41e0-ba48-aa4e784be9b3"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:12.370214 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:12.378005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:12.378538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:12.379162 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:12.380190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:12.380777 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:12.381532 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:12.386395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:12.725596 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c6719295-7aea-4764-8757-8510e7718558 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "POST /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363219 Aug 10 12:38:12.726131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 440/864] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:38:12 2022] POST /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:38:20.688664 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-383653f9-a568-475b-be52-9ed1d11a01e7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Action: 'create', calling method: .version_select at 0x7fcb92ce7430>, body: {"keypair": {"name": "tempest-TestShelveInstance-873003824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPZWm/8blYDzd2ig1YUY2VSQuruhsKzFo4Mk+/o/FArQ9ORSkt9VcJaPhuEwL5rl2pcLw3//1yH6V4F/ggB2kx6GZyi7Z1DETYmIaFB+ogbqYU9x+fMc1t2EOF/hcCOPg=="}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:20.715607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-383653f9-a568-475b-be52-9ed1d11a01e7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Getting quotas for project 65ece09339af406b98e493fa33f2b9c0. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:38:20.720536 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-383653f9-a568-475b-be52-9ed1d11a01e7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Getting quotas for user 94df22112d134130a678f91cae49adef and project 65ece09339af406b98e493fa33f2b9c0. Resources: {'key_pairs'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:38:20.760713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-383653f9-a568-475b-be52-9ed1d11a01e7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.330956 Aug 10 12:38:20.761217 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 425/865] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 10 12:38:20 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:21.558374 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:21.560610 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:21.567186 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:21.567662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:21.568097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:21.568988 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:21.569469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:21.569894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:21.606683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-69cb5a57-44c6-483f-8e5e-da131caab9e9 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053310 Aug 10 12:38:21.607274 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 441/866] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:38:21 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:21.747826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:21.753758 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:21.754595 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:21.762696 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:21.763376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:21.763818 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:21.765071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:21.765721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:21.766152 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:21.795954 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dfb599ee-ffe2-479f-912f-70d7bbb579f5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/bae4107c-5b73-4c1d-b6b5-443ffebf84dc" status: 200 len: 194 microversion: 2.1 time: 0.048696 Aug 10 12:38:21.796450 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 426/867] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 10 12:38:21 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/bae4107c-5b73-4c1d-b6b5-443ffebf84dc => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:21.806882 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:21.807624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:21.814897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:21.815577 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:21.816012 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:21.816718 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:21.817176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:21.817632 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:21.903583 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lazy-loading 'services' on Instance uuid b4528f4e-a5a6-4477-a906-aa36f45cb434 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:38:21.979195 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-26af37ba-d721-4f77-9950-e743e7fcbf7e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/bae4107c-5b73-4c1d-b6b5-443ffebf84dc" status: 202 len: 0 microversion: 2.1 time: 0.175756 Aug 10 12:38:21.979898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 442/868] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:38:21 2022] DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/bae4107c-5b73-4c1d-b6b5-443ffebf84dc => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:38:24.209203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:24.209782 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:24.220256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:24.221296 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:24.221908 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:24.223273 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:24.223805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:24.224937 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:24.269926 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a2e80f84-6fd8-4965-8262-df6f2ddb561b tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/9da28e07-b924-41e0-ba48-aa4e784be9b3" status: 200 len: 194 microversion: 2.1 time: 0.064573 Aug 10 12:38:24.270552 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 427/869] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 10 12:38:24 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/9da28e07-b924-41e0-ba48-aa4e784be9b3 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:24.284333 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:24.285019 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:24.291749 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:24.292333 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:24.292773 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:24.293556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:24.294011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:24.294438 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:24.388322 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lazy-loading 'services' on Instance uuid b4528f4e-a5a6-4477-a906-aa36f45cb434 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:38:24.464361 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8fef6a59-bc10-4687-9504-7c4f252ae816 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/9da28e07-b924-41e0-ba48-aa4e784be9b3" status: 202 len: 0 microversion: 2.1 time: 0.185428 Aug 10 12:38:24.464960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 443/870] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:38:24 2022] DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments/9da28e07-b924-41e0-ba48-aa4e784be9b3 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:38:25.643326 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:25.646344 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:25.653016 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:25.653446 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:25.654115 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:25.655342 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:25.655798 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:25.656220 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:25.685671 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7c7eb279-0a74-4676-a258-e3d708d0b232 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046262 Aug 10 12:38:25.686763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 428/871] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:38:25 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:38:25.808089 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:25.810276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:25.816983 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:25.817533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:25.818129 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:25.818902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:25.819571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:25.820030 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:25.852299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b5cd17b5-8003-40a1-8557-562e72974959 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049203 Aug 10 12:38:25.852856 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 444/872] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 10 12:38:25 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:38:25.918180 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:25.918681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:25.924769 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:25.925256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:25.925717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:25.926408 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:25.926863 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:25.927283 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:25.953611 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:38:26.051396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e9ac471b-662c-4411-b47c-75a4c71c8eb5 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 204 len: 0 microversion: 2.1 time: 0.136594 Aug 10 12:38:26.052112 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 429/873] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:38:25 2022] DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:38:26.060261 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:26.060868 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:26.068257 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:26.068744 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:26.069177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:26.069899 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:26.070354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:26.070775 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:26.224267 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:26.233220 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9be401ef-96ba-4216-a8cb-78b73e0944df tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1673 microversion: 2.1 time: 0.176687 Aug 10 12:38:26.233829 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 445/874] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:26 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:27.256151 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:27.256834 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:27.263119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:27.263596 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:27.264042 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:27.264731 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:27.265189 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:27.265635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:27.397260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:27.404799 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c01f548a-8344-404d-975b-3952923cb7d3 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1673 microversion: 2.1 time: 0.152901 Aug 10 12:38:27.405377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 430/875] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:27 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:28.428764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:28.429431 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:28.435590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:28.436571 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:28.437029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:28.437750 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:28.438229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:28.438657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:28.694218 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:28.704556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3bf76db6-5ec2-4977-aeac-1e97efa015bc tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1673 microversion: 2.1 time: 0.281077 Aug 10 12:38:28.718751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 446/876] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:28 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1673 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:29.186911 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-96c573dc-730c-43df-853c-e8ec362718bf req-ccb0f3a9-faac-492e-ae7e-a9ff17f43fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4528f4e-a5a6-4477-a906-aa36f45cb434", "name": "network-vif-deleted", "tag": "a7251038-f2c2-493d-b0a5-2bfc33676b23"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:29.201956 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-96c573dc-730c-43df-853c-e8ec362718bf req-ccb0f3a9-faac-492e-ae7e-a9ff17f43fda service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:29.203040 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-96c573dc-730c-43df-853c-e8ec362718bf req-ccb0f3a9-faac-492e-ae7e-a9ff17f43fda service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:29.203542 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-96c573dc-730c-43df-853c-e8ec362718bf req-ccb0f3a9-faac-492e-ae7e-a9ff17f43fda service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:29.214953 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-96c573dc-730c-43df-853c-e8ec362718bf req-ccb0f3a9-faac-492e-ae7e-a9ff17f43fda service nova] Creating event network-vif-deleted:a7251038-f2c2-493d-b0a5-2bfc33676b23 for instance b4528f4e-a5a6-4477-a906-aa36f45cb434 on hv-cinder-85226 Aug 10 12:38:29.220078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-96c573dc-730c-43df-853c-e8ec362718bf req-ccb0f3a9-faac-492e-ae7e-a9ff17f43fda service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037333 Aug 10 12:38:29.221199 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 431/877] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:29.726046 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:29.726684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:29.734276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:29.734923 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:29.735668 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:29.736659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:29.737467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:29.738089 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:29.771318 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:29.771810 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:29.772251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:29.772706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lazy-loading 'fault' on Instance uuid b4528f4e-a5a6-4477-a906-aa36f45cb434 {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:38:29.823425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6842565de354b0c85b04940d57c7432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82c24c64f4c34921837eceb32e24a287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:29.836730 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f5c8f50a-f75b-4a3b-b484-37f77c5a313d tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 200 len: 1327 microversion: 2.1 time: 0.114282 Aug 10 12:38:29.852457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 447/878] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:29 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:30.241524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:30.244524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:30.251782 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:30.254071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:30.254520 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:30.255266 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:30.255725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:30.256156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:30.289151 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d7d23231-f37a-408c-af66-911b4b85a101 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052494 Aug 10 12:38:30.289742 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 432/879] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 10 12:38:30 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:30.357585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:30.358710 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:30.364752 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:30.365244 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:30.365719 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:30.366410 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:30.366870 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:30.367296 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:30.391624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:38:30.476333 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b411a45c-a733-40fc-8436-7257b71bae3c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "DELETE /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 204 len: 0 microversion: 2.20 time: 0.122393 Aug 10 12:38:30.477058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 448/880] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 10 12:38:30 2022] DELETE /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 12:38:30.493192 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:30.496689 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:30.503720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:30.504210 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:30.504835 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:30.505587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:30.506072 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:30.506498 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:30.649865 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:30.659137 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:30.660852 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:30.661995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-07c17df5-03c5-42f9-a885-be45dbdbf04c tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.178789 Aug 10 12:38:30.662534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 433/881] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:38:30 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:38:30.860951 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:30.861676 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:30.867992 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:30.868483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:30.868932 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:30.869648 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:30.870104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:30.870672 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:30.883726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] HTTP exception thrown: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Request method failure captured: Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 HTTP/1.1 Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86VgyCRtfgzAcEXdAoLyUdT611H3LZWMB5IORGUmu_HfvGJR8lRMXsA7LwUeDhSPJEKjWicgTHzu12Xhc38t-dQgD1RapqsF5uxR8QUKno3rqapAQ8JTeVemiuRPj5TiBo7i23EXGfxGHjQcZ4keQIrKBUipfk83wuFCgaadQAvlGv8 Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:30.885411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82c24c64f4c34921837eceb32e24a287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}] Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: e6842565de354b0c85b04940d57c7432 Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:30.887139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'b4528f4e-a5a6-4477-a906-aa36f45cb434'} Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:30.888024 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:30.889635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:30.890952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Returning 404 to user: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:30.890952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7fe73909-e90c-4687-9fae-dc183e8dd933 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 404 len: 111 microversion: 2.1 time: 0.030874 Aug 10 12:38:30.890952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 449/882] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:30 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:38:30.895946 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8a400c5d-9dda-40ee-af44-457ce3b54dc1 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '.version_select at 0x7fcb92db0550>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:30.900613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=4 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:30.915252 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8a400c5d-9dda-40ee-af44-457ce3b54dc1 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673514588" status: 202 len: 0 microversion: 2.1 time: 0.023122 Aug 10 12:38:30.915826 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 434/883] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 10 12:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673514588 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:38:31.686652 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:31.687295 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:31.693433 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:31.693818 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:31.694270 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:31.694946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:31.695400 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:31.695824 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:31.829847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:31.838613 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:31.840425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:31.841706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3beaafcc-dda7-4eac-9e5d-e96db4168cc4 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.159339 Aug 10 12:38:31.842246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 450/884] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:38:31 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:38:32.864584 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:32.865148 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:32.871241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:32.871738 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:32.872183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:32.872889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:32.873391 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:32.874354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:33.040451 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:33.049298 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:33.051122 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a78bd1aed509474b965592c478cb1c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb5c9a17d7341d3a3dd60ef2b7a381d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:33.052498 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3d40c08d-cf3a-4ce8-9349-7ca19678a844 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 200 len: 1721 microversion: 2.20 time: 0.192027 Aug 10 12:38:33.053426 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 435/885] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:38:32 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:38:33.332247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-ad9b90bf-6eb8-44b9-bc4e-49ddc13068a6 req-860de1b2-fc1f-40e3-ab1e-cac99d18bf1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abef27e9-175c-4101-80ee-6da94e239088", "name": "network-vif-deleted", "tag": "40caaca6-10a7-43c8-8003-49d7c19f965f"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:33.354267 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ad9b90bf-6eb8-44b9-bc4e-49ddc13068a6 req-860de1b2-fc1f-40e3-ab1e-cac99d18bf1b service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:33.355082 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ad9b90bf-6eb8-44b9-bc4e-49ddc13068a6 req-860de1b2-fc1f-40e3-ab1e-cac99d18bf1b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:33.368659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ad9b90bf-6eb8-44b9-bc4e-49ddc13068a6 req-860de1b2-fc1f-40e3-ab1e-cac99d18bf1b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:33.395845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-ad9b90bf-6eb8-44b9-bc4e-49ddc13068a6 req-860de1b2-fc1f-40e3-ab1e-cac99d18bf1b service nova] Creating event network-vif-deleted:40caaca6-10a7-43c8-8003-49d7c19f965f for instance abef27e9-175c-4101-80ee-6da94e239088 on hv-cinder-85226 Aug 10 12:38:33.403418 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-ad9b90bf-6eb8-44b9-bc4e-49ddc13068a6 req-860de1b2-fc1f-40e3-ab1e-cac99d18bf1b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075053 Aug 10 12:38:33.404848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 451/886] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:33.803589 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:33.804184 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:33.810392 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:33.811176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:33.811621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:33.812325 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:33.812955 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:33.813424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:33.827918 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] HTTP exception thrown: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Request method failure captured: Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 HTTP/1.1 Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86VgyCRtfgzAcEXdAoLyUdT611H3LZWMB5IORGUmu_HfvGJR8lRMXsA7LwUeDhSPJEKjWicgTHzu12Xhc38t-dQgD1RapqsF5uxR8QUKno3rqapAQ8JTeVemiuRPj5TiBo7i23EXGfxGHjQcZ4keQIrKBUipfk83wuFCgaadQAvlGv8 Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:33.830299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82c24c64f4c34921837eceb32e24a287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}] Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: e6842565de354b0c85b04940d57c7432 Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.831629 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'b4528f4e-a5a6-4477-a906-aa36f45cb434'} Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:33.832380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.833607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.840844 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Returning 404 to user: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:33.842925 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2c9e1b00-7139-43ef-880c-8a5da5977621 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 404 len: 111 microversion: 2.1 time: 0.042672 Aug 10 12:38:33.843621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 436/887] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:38:33 2022] DELETE /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:38:33.852826 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:33.853782 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: b4528f4e-a5a6-4477-a906-aa36f45cb434] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:33.860922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:33.861451 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:33.861882 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:33.862753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:33.863238 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:33.863656 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:33.877814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] HTTP exception thrown: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Request method failure captured: Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 HTTP/1.1 Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86VgyCRtfgzAcEXdAoLyUdT611H3LZWMB5IORGUmu_HfvGJR8lRMXsA7LwUeDhSPJEKjWicgTHzu12Xhc38t-dQgD1RapqsF5uxR8QUKno3rqapAQ8JTeVemiuRPj5TiBo7i23EXGfxGHjQcZ4keQIrKBUipfk83wuFCgaadQAvlGv8 Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:33.879637 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82c24c64f4c34921837eceb32e24a287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}] Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: e6842565de354b0c85b04940d57c7432 Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.880917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'b4528f4e-a5a6-4477-a906-aa36f45cb434'} Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:33.881694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. Aug 10 12:38:33.882863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:33.883913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Returning 404 to user: Instance b4528f4e-a5a6-4477-a906-aa36f45cb434 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:33.883913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6a64e202-901e-44cb-8688-80061d29b88c tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434" status: 404 len: 111 microversion: 2.1 time: 0.032660 Aug 10 12:38:33.883913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 452/888] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:33 2022] GET /compute/v2.1/servers/b4528f4e-a5a6-4477-a906-aa36f45cb434 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:38:34.076151 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:34.077432 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:34.083882 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:34.084536 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:34.085059 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:34.086484 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:34.087198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:34.087766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:34.103030 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] HTTP exception thrown: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Request method failure captured: Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 HTTP/1.1 Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UTRJO1ms9qeirRevR4Q4K1dg1pUC5CVO8ew8WClAhTSvt90C6ioBMrJmcb2G_uJLVH0yf2VOy-BMwGRIBYXTQDl9xMQ5qWa3h1r1p5GG0y2o4Qz7GcaR5oA8zP9jT41bK7OpZmgUzm8zCrtJuAr0ULJF1XqUoRjjhTX5kjvZMij9U Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:34.104690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}] Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: a78bd1aed509474b965592c478cb1c0c Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:34.106400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'abef27e9-175c-4101-80ee-6da94e239088'} Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:34.107258 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:34.108445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:34.109814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Returning 404 to user: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:34.109814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dcbb7be0-25ed-4f55-88d2-c6d8e058924f tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 404 len: 111 microversion: 2.20 time: 0.033986 Aug 10 12:38:34.109814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 437/889] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:38:34 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:38:34.115533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f9072d14-c5a4-431a-91c0-f78a8394cca5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '.version_select at 0x7fcb92df2ee0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:34.135554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f9072d14-c5a4-431a-91c0-f78a8394cca5 tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185975824" status: 204 len: 0 microversion: 2.20 time: 0.023832 Aug 10 12:38:34.140169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 453/890] 10.222.0.65 () {60 vars in 1262 bytes} [Wed Aug 10 12:38:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185975824 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 12:38:35.060250 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:35.060824 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:35.067514 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:35.068084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:35.068603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:35.069535 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:35.070156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:35.070701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:35.088979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] HTTP exception thrown: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Request method failure captured: Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 HTTP/1.1 Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86VgyCRtfgzAcEXdAoLyUdT611H3LZWMB5IORGUmu_HfvGJR8lRMXsA7LwUeDhSPJEKjWicgTHzu12Xhc38t-dQgD1RapqsF5uxR8QUKno3rqapAQ8JTeVemiuRPj5TiBo7i23EXGfxGHjQcZ4keQIrKBUipfk83wuFCgaadQAvlGv8 Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:35.090950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82c24c64f4c34921837eceb32e24a287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}] Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: e6842565de354b0c85b04940d57c7432 Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.092507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '67832a65-635c-45ac-830c-7ae989a1fea6'} Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:35.096812 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.098074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.099445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Returning 404 to user: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:35.099445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-307eb444-2702-48c1-b478-e4eaec0b0891 tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 404 len: 111 microversion: 2.1 time: 0.036767 Aug 10 12:38:35.099445 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 438/891] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:38:35 2022] DELETE /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:38:35.102473 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:35.103135 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] [instance: 67832a65-635c-45ac-830c-7ae989a1fea6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:35.109842 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:35.110353 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:35.110785 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:35.111471 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:35.111925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:35.112349 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:35.125483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] HTTP exception thrown: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Request method failure captured: Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 HTTP/1.1 Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86VgyCRtfgzAcEXdAoLyUdT611H3LZWMB5IORGUmu_HfvGJR8lRMXsA7LwUeDhSPJEKjWicgTHzu12Xhc38t-dQgD1RapqsF5uxR8QUKno3rqapAQ8JTeVemiuRPj5TiBo7i23EXGfxGHjQcZ4keQIrKBUipfk83wuFCgaadQAvlGv8 Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:35.126989 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82c24c64f4c34921837eceb32e24a287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82c24c64f4c34921837eceb32e24a287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82c24c64f4c34921837eceb32e24a287"}]}] Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 82c24c64f4c34921837eceb32e24a287 Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeTestJSON-58944132 Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: e6842565de354b0c85b04940d57c7432 Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeTestJSON-58944132-project Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.128504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '67832a65-635c-45ac-830c-7ae989a1fea6'} Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:35.129554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. Aug 10 12:38:35.130925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.131993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] Returning 404 to user: Instance 67832a65-635c-45ac-830c-7ae989a1fea6 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:35.131993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4fcee9fd-36c7-4e4a-8b18-2f01b0b2046e tempest-AttachVolumeTestJSON-58944132 tempest-AttachVolumeTestJSON-58944132-project] 10.222.0.65 "GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6" status: 404 len: 111 microversion: 2.1 time: 0.030737 Aug 10 12:38:35.131993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 454/892] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:35 2022] GET /compute/v2.1/servers/67832a65-635c-45ac-830c-7ae989a1fea6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 12:38:35.973315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:35.973315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:35.973315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:35.973315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:35.973717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:35.973717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:35.973931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:35.974582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:35.989413 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] HTTP exception thrown: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Request method failure captured: Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 HTTP/1.1 Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UTRJO1ms9qeirRevR4Q4K1dg1pUC5CVO8ew8WClAhTSvt90C6ioBMrJmcb2G_uJLVH0yf2VOy-BMwGRIBYXTQDl9xMQ5qWa3h1r1p5GG0y2o4Qz7GcaR5oA8zP9jT41bK7OpZmgUzm8zCrtJuAr0ULJF1XqUoRjjhTX5kjvZMij9U Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:35.991026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}] Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: a78bd1aed509474b965592c478cb1c0c Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:35.992351 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'abef27e9-175c-4101-80ee-6da94e239088'} Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:35.993114 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:35.994349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:35.995589 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Returning 404 to user: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:35.995589 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f161e209-1856-4ad2-88d5-d1b8055255fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "DELETE /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 404 len: 111 microversion: 2.20 time: 0.033071 Aug 10 12:38:35.995589 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 439/893] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 10 12:38:35 2022] DELETE /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:38:36.001497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:36.002104 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: abef27e9-175c-4101-80ee-6da94e239088] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:36.007972 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:36.008381 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:36.008838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:36.009628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:36.010308 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:36.010738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:36.025031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] HTTP exception thrown: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Request method failure captured: Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 HTTP/1.1 Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UTRJO1ms9qeirRevR4Q4K1dg1pUC5CVO8ew8WClAhTSvt90C6ioBMrJmcb2G_uJLVH0yf2VOy-BMwGRIBYXTQDl9xMQ5qWa3h1r1p5GG0y2o4Qz7GcaR5oA8zP9jT41bK7OpZmgUzm8zCrtJuAr0ULJF1XqUoRjjhTX5kjvZMij9U Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:36.026615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}] Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: a78bd1aed509474b965592c478cb1c0c Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:36.027996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'abef27e9-175c-4101-80ee-6da94e239088'} Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:36.028817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. Aug 10 12:38:36.030550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:36.032942 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Returning 404 to user: Instance abef27e9-175c-4101-80ee-6da94e239088 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:36.034002 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b38be09e-7da2-4502-9408-5756f0a78c0d tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088" status: 404 len: 111 microversion: 2.20 time: 0.036462 Aug 10 12:38:36.034552 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 455/894] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:38:35 2022] GET /compute/v2.1/servers/abef27e9-175c-4101-80ee-6da94e239088 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 12:38:37.215929 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:37.216695 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:37.226161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:37.226741 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:37.227266 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:37.228197 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:37.228732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:37.229225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:37.243489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] HTTP exception thrown: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Request method failure captured: Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 HTTP/1.1 Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86UTRJO1ms9qeirRevR4Q4K1dg1pUC5CVO8ew8WClAhTSvt90C6ioBMrJmcb2G_uJLVH0yf2VOy-BMwGRIBYXTQDl9xMQ5qWa3h1r1p5GG0y2o4Qz7GcaR5oA8zP9jT41bK7OpZmgUzm8zCrtJuAr0ULJF1XqUoRjjhTX5kjvZMij9U Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:37.245145 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}] Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: a78bd1aed509474b965592c478cb1c0c Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.246602 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2'} Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:37.247346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.249254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.250554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Returning 404 to user: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:37.250554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-093bda26-91ab-4375-8f20-68209079e5fa tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 404 len: 111 microversion: 2.20 time: 0.040772 Aug 10 12:38:37.250554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 440/895] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 10 12:38:37 2022] DELETE /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:38:37.256476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:37.257124 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] [instance: b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:37.263854 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:37.264370 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:37.264814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:37.265594 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:37.266076 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:37.266533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:37.280716 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] HTTP exception thrown: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Request method failure captured: Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 HTTP/1.1 Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86UTRJO1ms9qeirRevR4Q4K1dg1pUC5CVO8ew8WClAhTSvt90C6ioBMrJmcb2G_uJLVH0yf2VOy-BMwGRIBYXTQDl9xMQ5qWa3h1r1p5GG0y2o4Qz7GcaR5oA8zP9jT41bK7OpZmgUzm8zCrtJuAr0ULJF1XqUoRjjhTX5kjvZMij9U Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:37.282485 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4eb5c9a17d7341d3a3dd60ef2b7a381d"}]}] Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 4eb5c9a17d7341d3a3dd60ef2b7a381d Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489513011 Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: a78bd1aed509474b965592c478cb1c0c Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489513011-project Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.283853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2'} Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:37.284598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. Aug 10 12:38:37.285801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:37.286893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] Returning 404 to user: Instance b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:37.286893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5a8bfe8d-2b89-465a-bc97-da853d75e5ae tempest-AttachVolumeShelveTestJSON-489513011 tempest-AttachVolumeShelveTestJSON-489513011-project] 10.222.0.65 "GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2" status: 404 len: 111 microversion: 2.20 time: 0.031444 Aug 10 12:38:37.286893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 456/896] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 10 12:38:37 2022] GET /compute/v2.1/servers/b031e4a2-3e92-40ec-bd4f-428e8ab6e0b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:38:40.043170 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6e26c4cc-4a2b-46e5-8981-1a055ac4321e tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Action: 'create', calling method: .version_select at 0x7fcb92cc8a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-978925300", "metadata": {"Type": "work"}}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:40.494830 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6e26c4cc-4a2b-46e5-8981-1a055ac4321e tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.586309 Aug 10 12:38:40.495876 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 441/897] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 10 12:38:39 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 588 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 12:38:40.509514 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-caff6dc5-7311-44f3-a4bb-1cad98ab112f tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Calling method '.version_select at 0x7fcb92e62550>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:40.693945 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-caff6dc5-7311-44f3-a4bb-1cad98ab112f tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3" status: 200 len: 352 microversion: 2.1 time: 0.188459 Aug 10 12:38:40.694523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 457/898] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:38:40 2022] GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3 => generated 352 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:40.806268 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-587347924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-873003824", "security_groups": [{"name": "tempest-secgroup-smoke-1746333518"}], "networks": [{"uuid": "a4f38671-a0fe-4d93-81a4-a719e9fa0c01"}], "block_device_mapping_v2": [{"uuid": "0d0b275a-2daf-44fb-a02d-5580c5cda0b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:40.974707 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] validate_networks() for [('a4f38671-a0fe-4d93-81a4-a719e9fa0c01', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:38:41.177638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:41.391555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:38:41.392104 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:38:41.392876 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:38:41.393332 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:38:41.393987 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:38:41.404697 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:41.405495 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:41.405936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:41.406899 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:41.407413 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:41.407903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:41.427721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Getting quotas for project 65ece09339af406b98e493fa33f2b9c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:38:41.431854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Getting quotas for user 94df22112d134130a678f91cae49adef and project 65ece09339af406b98e493fa33f2b9c0. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:38:41.491928 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:38:41.494123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d0b275a-2daf-44fb-a02d-5580c5cda0b1',volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:38:41.633082 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-399dd13f-111e-4c49-8cea-bedc57518963 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.830796 Aug 10 12:38:41.645371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 442/899] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:38:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:38:41.650912 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e32ca6bd-3895-4932-8514-10b378e9fe41 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:41.651540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e32ca6bd-3895-4932-8514-10b378e9fe41 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:41.654057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:41.707912 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0c029b7f-1070-4b10-9615-5f50f7863773 tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Calling method '.version_select at 0x7fcb92d73b80>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:41.731425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e32ca6bd-3895-4932-8514-10b378e9fe41 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:41.739175 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e32ca6bd-3895-4932-8514-10b378e9fe41 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1087 microversion: 2.1 time: 0.098450 Aug 10 12:38:41.747243 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 458/900] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:41 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1087 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:38:41.788732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0c029b7f-1070-4b10-9615-5f50f7863773 tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3" status: 200 len: 353 microversion: 2.1 time: 0.085396 Aug 10 12:38:41.789555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 443/901] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:38:41 2022] GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:38:41.802676 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f755e80a-1f5f-4224-802d-0e1f866c8c30 tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Calling method '.version_select at 0x7fcb92e2fe50>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:41.864014 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f755e80a-1f5f-4224-802d-0e1f866c8c30 tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3" status: 200 len: 353 microversion: 2.1 time: 0.065083 Aug 10 12:38:41.864725 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 459/902] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:38:41 2022] GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:38:41.878009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d1ed79e2-f094-4b49-94a5-3ee5038c526d tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Calling method '.version_select at 0x7fcb980258b0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:41.971617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d1ed79e2-f094-4b49-94a5-3ee5038c526d tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3" status: 202 len: 0 microversion: 2.1 time: 0.097331 Aug 10 12:38:41.972182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 444/903] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:38:41 2022] DELETE /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:38:41.984932 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ad716525-66d8-48d5-9401-5f072d5cd5d9 tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Calling method '.version_select at 0x7fcb92e314c0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:42.071112 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ad716525-66d8-48d5-9401-5f072d5cd5d9 tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3" status: 200 len: 352 microversion: 2.1 time: 0.090701 Aug 10 12:38:42.071674 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 460/904] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:38:41 2022] GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:42.760232 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:42.760853 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:42.768115 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:42.768849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:42.770154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:42.771168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:42.771790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:42.772372 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:42.855753 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:42.866735 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e54c24e6-a3af-498a-a023-e78230e14c00 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1185 microversion: 2.1 time: 0.110417 Aug 10 12:38:42.875100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 445/905] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:42 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:43.086915 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-18f93ce4-5f41-4410-a765-5c336b36540f tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Calling method '.version_select at 0x7fcb92e0caf0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:43.137588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-18f93ce4-5f41-4410-a765-5c336b36540f tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] HTTP exception thrown: Volume ddd78188-7440-4d1a-ab0a-e91f10d111a3 could not be found. Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-18f93ce4-5f41-4410-a765-5c336b36540f tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Request method failure captured: Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3 HTTP/1.1 Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86bPWvrLGx66DFIOThtAQEEg9U25J4YcLc8rQAfK3lzNTsDjYul4izf1gSwV1xdsmf5LW5GLNInL3QLDX1iF-OJoTcLIHOFSANqNHlFiHC-EzJaVwCXfHN9EBkVDIdCZVdlRrt3ku_NLBAhlbdJj3YvgO9PKCb6EhNSCJ-PKrfYpnwg Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: e23b799cef7e44ffa8fd6278eec6396c Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesGetTestJSON-2079047439 Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:43.140146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e23b799cef7e44ffa8fd6278eec6396c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e23b799cef7e44ffa8fd6278eec6396c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e23b799cef7e44ffa8fd6278eec6396c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e23b799cef7e44ffa8fd6278eec6396c"}]}] Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesGetTestJSON-2079047439 Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: e23b799cef7e44ffa8fd6278eec6396c Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesGetTestJSON-2079047439 Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesGetTestJSON-2079047439-project Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: cd0238d8b217440e84327957c4b9ade1 Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesGetTestJSON-2079047439-project Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Volume ddd78188-7440-4d1a-ab0a-e91f10d111a3 could not be found. Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'ddd78188-7440-4d1a-ab0a-e91f10d111a3'} Aug 10 12:38:43.141651 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ddd78188-7440-4d1a-ab0a-e91f10d111a3 could not be found. (HTTP 404) (Request-ID: req-d30cc88b-7046-4822-8cdb-bd2851f803f6) Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:43.142523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:38:43.143726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ddd78188-7440-4d1a-ab0a-e91f10d111a3 could not be found. Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 12:38:43.144851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ddd78188-7440-4d1a-ab0a-e91f10d111a3 could not be found. Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ddd78188-7440-4d1a-ab0a-e91f10d111a3 could not be found. Aug 10 12:38:43.146840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:43.148431 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-18f93ce4-5f41-4410-a765-5c336b36540f tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] Returning 404 to user: Volume ddd78188-7440-4d1a-ab0a-e91f10d111a3 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:43.149641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-18f93ce4-5f41-4410-a765-5c336b36540f tempest-VolumesGetTestJSON-2079047439 tempest-VolumesGetTestJSON-2079047439-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3" status: 404 len: 109 microversion: 2.1 time: 0.068504 Aug 10 12:38:43.150360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 461/906] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:38:43 2022] GET /compute/v2.1/os-volumes/ddd78188-7440-4d1a-ab0a-e91f10d111a3 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 12:38:43.889825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:43.890627 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:43.897882 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:43.898686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:43.899339 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:43.900280 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:43.907779 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:43.909003 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:44.200965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:44.217707 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3951138f-f851-419d-9abd-296f885acd2b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.331332 Aug 10 12:38:44.219538 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 446/907] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:43 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:44.747606 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-06806943-0d98-4401-8e8f-82baa3379400 req-9ee70851-a393-4bfd-bf1b-a219434368a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d0cda6b-0e67-4271-898c-65bd1636dec8", "tag": "0bcd71a0-e429-40d7-b546-9eb4fc13e34a"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:44.757704 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-06806943-0d98-4401-8e8f-82baa3379400 req-9ee70851-a393-4bfd-bf1b-a219434368a6 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:44.758399 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-06806943-0d98-4401-8e8f-82baa3379400 req-9ee70851-a393-4bfd-bf1b-a219434368a6 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:44.758983 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-06806943-0d98-4401-8e8f-82baa3379400 req-9ee70851-a393-4bfd-bf1b-a219434368a6 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:44.762982 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:44.773437 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-06806943-0d98-4401-8e8f-82baa3379400 req-9ee70851-a393-4bfd-bf1b-a219434368a6 service nova] Creating event network-changed:0bcd71a0-e429-40d7-b546-9eb4fc13e34a for instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 on hv-cinder-85226 Aug 10 12:38:44.785925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-06806943-0d98-4401-8e8f-82baa3379400 req-9ee70851-a393-4bfd-bf1b-a219434368a6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042396 Aug 10 12:38:44.786524 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 462/908] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:38:45.253683 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:45.258950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:45.278652 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:45.279404 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:45.280756 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:45.282212 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:45.283129 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:45.283953 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:45.465665 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:45.473567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4634bf22-bb42-47e9-9e90-3ca1a6ac514b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.232109 Aug 10 12:38:45.474144 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 447/909] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:45 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:45.946725 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e5606c02-ed0d-467a-9c7f-90990f374540 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Action: 'create', calling method: .version_select at 0x7fcb982638b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1504090539", "metadata": {"Type": "work"}}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e5606c02-ed0d-467a-9c7f-90990f374540 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Request method failure captured: Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 122 Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86bVJTHePPPo8hCugAly2va9ZCV5lwpv5O60dnlBrqLTSi6aXdNiAlj22wEZZL94RBkQuoaui7oDZVFCtzn8Pu7EU_SXDj0-ahPzfwYdCvZmIgpHGdY3SQM8OxkT1IZWvgtESlYZGL984Q10mneSAkvTErzQ-uTa9hSr8WCXAAS4k0g Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:45.969599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}] Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: af5cbf7c8de043aa802078cb0e0a4afa Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1504090539", "metadata": {"Type": "work"}}} Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: Aug 10 12:38:45.971487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1504090539', 'metadata': {'Type': 'work'}}}} Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise error Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:45.972497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 12:38:45.974422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 12:38:45.975702 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 12:38:45.975702 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.977401 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e5606c02-ed0d-467a-9c7f-90990f374540 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:45.978704 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e5606c02-ed0d-467a-9c7f-90990f374540 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.292845 Aug 10 12:38:45.980039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 463/910] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 10 12:38:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:38:45.990829 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-97215e69-e885-4643-880c-f4180f982aaa tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Action: 'create', calling method: .version_select at 0x7fcb92ed8430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1432903599", "metadata": {"Type": "work"}}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-97215e69-e885-4643-880c-f4180f982aaa tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Request method failure captured: Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 120 Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86bVJTHePPPo8hCugAly2va9ZCV5lwpv5O60dnlBrqLTSi6aXdNiAlj22wEZZL94RBkQuoaui7oDZVFCtzn8Pu7EU_SXDj0-ahPzfwYdCvZmIgpHGdY3SQM8OxkT1IZWvgtESlYZGL984Q10mneSAkvTErzQ-uTa9hSr8WCXAAS4k0g Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:45.995480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}] Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: af5cbf7c8de043aa802078cb0e0a4afa Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1432903599", "metadata": {"Type": "work"}}} Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: Aug 10 12:38:45.997014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1432903599', 'metadata': {'Type': 'work'}}}} Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise error Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi '0' Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:45.997993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 12:38:46.000721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 12:38:46.002264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 12:38:46.002264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.002264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-97215e69-e885-4643-880c-f4180f982aaa tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:46.002264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-97215e69-e885-4643-880c-f4180f982aaa tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010086 Aug 10 12:38:46.002264 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 448/911] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 10 12:38:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:38:46.008308 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-63b92d44-b0d4-43bf-95d0-d6b4155e18d3 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Action: 'create', calling method: .version_select at 0x7fcb92df2af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1156039582", "metadata": {"Type": "work"}}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-63b92d44-b0d4-43bf-95d0-d6b4155e18d3 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Request method failure captured: Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 119 Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86bVJTHePPPo8hCugAly2va9ZCV5lwpv5O60dnlBrqLTSi6aXdNiAlj22wEZZL94RBkQuoaui7oDZVFCtzn8Pu7EU_SXDj0-ahPzfwYdCvZmIgpHGdY3SQM8OxkT1IZWvgtESlYZGL984Q10mneSAkvTErzQ-uTa9hSr8WCXAAS4k0g Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:46.011890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}] Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: af5cbf7c8de043aa802078cb0e0a4afa Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1156039582", "metadata": {"Type": "work"}}} Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: Aug 10 12:38:46.013707 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1156039582', 'metadata': {'Type': 'work'}}}} Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise error Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi '' Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:46.015259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 12:38:46.016894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 12:38:46.019355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 12:38:46.019355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.019355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-63b92d44-b0d4-43bf-95d0-d6b4155e18d3 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:46.019355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-63b92d44-b0d4-43bf-95d0-d6b4155e18d3 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009156 Aug 10 12:38:46.019355 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 464/912] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 10 12:38:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:38:46.023743 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cba2e41d-0602-45ce-a456-b6391175bd87 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Calling method '.version_select at 0x7fcb92f3d550>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:46.058845 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-cba2e41d-0602-45ce-a456-b6391175bd87 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] HTTP exception thrown: Volume tempest-invalid-183107995 could not be found. Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cba2e41d-0602-45ce-a456-b6391175bd87 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Request method failure captured: Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-183107995 HTTP/1.1 Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86bVJTHePPPo8hCugAly2va9ZCV5lwpv5O60dnlBrqLTSi6aXdNiAlj22wEZZL94RBkQuoaui7oDZVFCtzn8Pu7EU_SXDj0-ahPzfwYdCvZmIgpHGdY3SQM8OxkT1IZWvgtESlYZGL984Q10mneSAkvTErzQ-uTa9hSr8WCXAAS4k0g Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:46.062764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}] Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: af5cbf7c8de043aa802078cb0e0a4afa Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Volume tempest-invalid-183107995 could not be found. Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'tempest-invalid-183107995'} Aug 10 12:38:46.064088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-183107995 could not be found. (HTTP 404) (Request-ID: req-022536a5-32f6-4a3b-a1bd-af0417f835e2) Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.064867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 12:38:46.066053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-183107995 could not be found. Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:46.067341 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-183107995 could not be found. Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-183107995 could not be found. Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.069004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cba2e41d-0602-45ce-a456-b6391175bd87 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Returning 404 to user: Volume tempest-invalid-183107995 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:46.070098 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cba2e41d-0602-45ce-a456-b6391175bd87 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-183107995" status: 404 len: 98 microversion: 2.1 time: 0.050392 Aug 10 12:38:46.072407 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 449/913] 10.222.0.65 () {58 vars in 1215 bytes} [Wed Aug 10 12:38:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-183107995 => generated 98 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 12:38:46.084509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-8505046d-fa37-4445-86e6-941da2539031 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004342 Aug 10 12:38:46.089725 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 465/914] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 10 12:38:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 12:38:46.094543 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e43a6149-5c29-44bc-8d7e-b81e656762c3 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004023 Aug 10 12:38:46.095125 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 450/915] 10.222.0.65 () {58 vars in 1137 bytes} [Wed Aug 10 12:38:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 12:38:46.104181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c5c73e2c-26b0-4081-b1c7-0b2549f1b10f tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Calling method '.version_select at 0x7fcb92df2ca0>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:46.144429 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-c5c73e2c-26b0-4081-b1c7-0b2549f1b10f tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] HTTP exception thrown: Volume a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 could not be found. Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c5c73e2c-26b0-4081-b1c7-0b2549f1b10f tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Request method failure captured: Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: DELETE /compute/v2.1/os-volumes/a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 HTTP/1.1 Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86bVJTHePPPo8hCugAly2va9ZCV5lwpv5O60dnlBrqLTSi6aXdNiAlj22wEZZL94RBkQuoaui7oDZVFCtzn8Pu7EU_SXDj0-ahPzfwYdCvZmIgpHGdY3SQM8OxkT1IZWvgtESlYZGL984Q10mneSAkvTErzQ-uTa9hSr8WCXAAS4k0g Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:38:46.146551 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}] Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: af5cbf7c8de043aa802078cb0e0a4afa Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Volume a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 could not be found. Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818'} Aug 10 12:38:46.147820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 could not be found. (HTTP 404) (Request-ID: req-3308a28e-7a27-48b1-832a-825836b77546) Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.153063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 12:38:46.154304 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 could not be found. Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 12:38:46.156016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 could not be found. Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 could not be found. Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c5c73e2c-26b0-4081-b1c7-0b2549f1b10f tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Returning 404 to user: Volume a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c5c73e2c-26b0-4081-b1c7-0b2549f1b10f tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818" status: 404 len: 109 microversion: 2.1 time: 0.047464 Aug 10 12:38:46.157116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 466/916] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 10 12:38:46 2022] DELETE /compute/v2.1/os-volumes/a5f0cf59-ee3d-4e33-8c0d-2f8fff6b7818 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:38:46.158193 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ca03807c-2c22-44d9-8930-168e4092abd4 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Calling method '.version_select at 0x7fcb92d73f70>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:46.195440 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-ca03807c-2c22-44d9-8930-168e4092abd4 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] HTTP exception thrown: Volume bf9316f0-f547-4fab-96d7-c7c23d7dd85d could not be found. Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ca03807c-2c22-44d9-8930-168e4092abd4 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Request method failure captured: Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/os-volumes/bf9316f0-f547-4fab-96d7-c7c23d7dd85d HTTP/1.1 Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86bVJTHePPPo8hCugAly2va9ZCV5lwpv5O60dnlBrqLTSi6aXdNiAlj22wEZZL94RBkQuoaui7oDZVFCtzn8Pu7EU_SXDj0-ahPzfwYdCvZmIgpHGdY3SQM8OxkT1IZWvgtESlYZGL984Q10mneSAkvTErzQ-uTa9hSr8WCXAAS4k0g Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:38:46.197458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/25007538371040b09fa5dd940ac7a6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/25007538371040b09fa5dd940ac7a6c3"}]}] Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: 25007538371040b09fa5dd940ac7a6c3 Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesNegativeTest-1501197158 Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: af5cbf7c8de043aa802078cb0e0a4afa Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesNegativeTest-1501197158-project Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Volume bf9316f0-f547-4fab-96d7-c7c23d7dd85d could not be found. Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'bf9316f0-f547-4fab-96d7-c7c23d7dd85d'} Aug 10 12:38:46.198759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf9316f0-f547-4fab-96d7-c7c23d7dd85d could not be found. (HTTP 404) (Request-ID: req-df609806-bdb9-49cb-a2c0-5bada1bf73f2) Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.208063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:38:46.209613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf9316f0-f547-4fab-96d7-c7c23d7dd85d could not be found. Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 12:38:46.210720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf9316f0-f547-4fab-96d7-c7c23d7dd85d could not be found. Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf9316f0-f547-4fab-96d7-c7c23d7dd85d could not be found. Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ca03807c-2c22-44d9-8930-168e4092abd4 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] Returning 404 to user: Volume bf9316f0-f547-4fab-96d7-c7c23d7dd85d could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ca03807c-2c22-44d9-8930-168e4092abd4 tempest-VolumesNegativeTest-1501197158 tempest-VolumesNegativeTest-1501197158-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/bf9316f0-f547-4fab-96d7-c7c23d7dd85d" status: 404 len: 109 microversion: 2.1 time: 0.045323 Aug 10 12:38:46.213005 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 451/917] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 10 12:38:46 2022] GET /compute/v2.1/os-volumes/bf9316f0-f547-4fab-96d7-c7c23d7dd85d => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:38:46.494398 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:46.495293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:46.503903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:46.504683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:46.505222 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:46.506017 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:46.506799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:46.507416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:46.661870 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:46.675168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b1651e14-967a-4647-89b6-df0f196efda0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.184603 Aug 10 12:38:46.676052 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 467/918] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:46 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:47.697840 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:47.698457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:47.705563 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:47.706058 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:47.706504 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:47.707211 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:47.707726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:47.708156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:47.899054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:47.907026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3b82ec49-0043-4cdb-866e-7135cd2475ea tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.214234 Aug 10 12:38:47.911378 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 452/919] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:47 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:48.932258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:48.933611 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:48.942167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:48.942997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:48.943759 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:48.945060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:48.946270 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:48.946882 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:49.103410 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:49.114036 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ecc05481-29fb-4501-9dd8-be114ef5a9fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.186924 Aug 10 12:38:49.114824 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 468/920] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:48 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:50.135144 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:50.135749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:50.145801 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:50.146293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:50.150026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:50.150766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:50.151401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:50.152007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:50.176983 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:50.354336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:50.371573 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e0f89fd2-7570-470f-aa72-2431ee7e595c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.240175 Aug 10 12:38:50.384650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 453/921] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:50 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:51.392985 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:51.394980 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:51.403490 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:51.404596 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:51.405853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:51.406832 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:51.407954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:51.409011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:51.667783 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:51.677353 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-63f9c7b8-e83c-41fb-a2f2-f92e6db5c486 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.288755 Aug 10 12:38:51.679747 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 469/922] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:51 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:52.702356 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:52.703532 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:52.707790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:52.708624 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:52.712889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:52.713945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:52.714819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:52.715684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:52.716603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:52.717721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:52.937612 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:52.957480 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cdc67299-d87f-4fc2-8839-6a2d9b1c772c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.258404 Aug 10 12:38:52.962402 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 454/923] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:52 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:53.726687 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-928f4236-5519-40b4-8d0d-83ba8d1efbac req-76ee3206-dd40-4386-ac88-9f2c5d9eae27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0cda6b-0e67-4271-898c-65bd1636dec8", "name": "network-vif-plugged", "status": "completed", "tag": "0bcd71a0-e429-40d7-b546-9eb4fc13e34a"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:53.741504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:38:53.747085 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-928f4236-5519-40b4-8d0d-83ba8d1efbac req-76ee3206-dd40-4386-ac88-9f2c5d9eae27 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:53.747659 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-928f4236-5519-40b4-8d0d-83ba8d1efbac req-76ee3206-dd40-4386-ac88-9f2c5d9eae27 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:53.748329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-928f4236-5519-40b4-8d0d-83ba8d1efbac req-76ee3206-dd40-4386-ac88-9f2c5d9eae27 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:53.761885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-928f4236-5519-40b4-8d0d-83ba8d1efbac req-76ee3206-dd40-4386-ac88-9f2c5d9eae27 service nova] Creating event network-vif-plugged:0bcd71a0-e429-40d7-b546-9eb4fc13e34a for instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 on hv-cinder-85226 Aug 10 12:38:53.768118 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-928f4236-5519-40b4-8d0d-83ba8d1efbac req-76ee3206-dd40-4386-ac88-9f2c5d9eae27 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045618 Aug 10 12:38:53.769176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 470/924] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:38:53.978350 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:53.979108 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:53.989095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:53.990692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:53.991305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:53.992436 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:54.006249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:54.006817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:54.207584 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:54.215515 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-596cad5f-c967-4b45-b6e0-e02f15fb2219 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.244684 Aug 10 12:38:54.216368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 455/925] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:53 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:55.239590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:55.241088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:55.247903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:55.249350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:55.250038 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:55.251007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:55.251728 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:55.252379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:55.399887 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:55.408515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-875cd624-8969-479f-9298-0da80aa1533a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.173787 Aug 10 12:38:55.422082 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 471/926] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:55 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:56.436859 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:56.438207 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:56.448623 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:56.449927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:56.450943 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:56.452795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:56.453724 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:56.454373 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:56.614941 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:56.624533 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-11daddd9-eb4e-4b55-bfd2-6b21182cb783 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.194577 Aug 10 12:38:56.625617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 456/927] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:56 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:38:57.646615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:57.647738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:57.668909 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:57.672197 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:57.672792 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:57.673700 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:57.675167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:57.675597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:57.859077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:57.867497 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d3741043-1d37-432f-8e7b-4327c55baa7c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1259 microversion: 2.1 time: 0.225798 Aug 10 12:38:57.868158 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 472/928] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:57 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:58.149607 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1636180912", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "networks": [{"uuid": "dc107b9b-6365-4e19-9b21-085b02ba9b19"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:38:58.201893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] validate_networks() for [('dc107b9b-6365-4e19-9b21-085b02ba9b19', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:38:58.544707 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:38:58.545132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:38:58.545656 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:38:58.546111 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:38:58.546527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:38:58.555235 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:58.555725 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:58.556193 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:58.556925 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:58.557425 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:58.557851 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:58.574655 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Getting quotas for project afa4735b7c5b46bc9a0ca81f4733de00. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:38:58.579011 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Getting quotas for user 9d593e55f72d4757886261b383e1794f and project afa4735b7c5b46bc9a0ca81f4733de00. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:38:58.589693 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:38:58.591869 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:38:58.636110 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-43c0593c-d0f8-441c-8af2-1578b4305a59 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490462 Aug 10 12:38:58.636766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 457/929] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:38:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 12:38:58.648081 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d9c4286c-76b4-480c-ad20-5e0ab82df8ac tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:58.648723 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d9c4286c-76b4-480c-ad20-5e0ab82df8ac tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:58.706762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d9c4286c-76b4-480c-ad20-5e0ab82df8ac tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:58.713783 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d9c4286c-76b4-480c-ad20-5e0ab82df8ac tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1214 microversion: 2.1 time: 0.069532 Aug 10 12:38:58.714350 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 473/930] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:58 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:58.888848 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:58.889505 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:58.898324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:58.898819 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:58.899305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:58.899950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:58.900412 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:58.900842 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:59.034166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:59.044852 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6b7dde98-02b1-4799-93d5-3fae1f3c5979 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1442 microversion: 2.1 time: 0.159890 Aug 10 12:38:59.046106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 458/931] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:58 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:59.065922 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:59.066549 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:59.072794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:59.073609 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:59.073996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:59.074770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:59.075303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:59.075807 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:59.230953 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:59.239996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-eded8211-8d41-49a4-8717-17087716d525 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1442 microversion: 2.1 time: 0.177694 Aug 10 12:38:59.245880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 474/932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:59 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1442 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:38:59.735354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:38:59.735947 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:38:59.743237 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:59.743884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:59.744414 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:59.750433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:38:59.751038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:38:59.751552 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:38:59.825883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:38:59.835527 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e1924276-5a38-4222-b132-7edda1754ef0 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1274 microversion: 2.1 time: 0.104036 Aug 10 12:38:59.836154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 459/933] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:38:59 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:00.857005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:00.858334 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:00.864387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:00.868731 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:00.873990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:00.874767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:00.875250 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:00.875685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:01.194347 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:01.202491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ee62d30c-770e-4611-bb6c-8f6a8f7a3153 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1314 microversion: 2.1 time: 0.349097 Aug 10 12:39:01.202985 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 475/934] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:00 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:01.385955 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-f5fb32d1-e23d-48d4-93b0-cd22324f1fbd req-26067f71-b318-486f-b818-c41908029b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d0cda6b-0e67-4271-898c-65bd1636dec8", "tag": "0bcd71a0-e429-40d7-b546-9eb4fc13e34a"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:01.397544 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f5fb32d1-e23d-48d4-93b0-cd22324f1fbd req-26067f71-b318-486f-b818-c41908029b8b service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:01.398263 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f5fb32d1-e23d-48d4-93b0-cd22324f1fbd req-26067f71-b318-486f-b818-c41908029b8b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:01.398890 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f5fb32d1-e23d-48d4-93b0-cd22324f1fbd req-26067f71-b318-486f-b818-c41908029b8b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:01.412069 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-f5fb32d1-e23d-48d4-93b0-cd22324f1fbd req-26067f71-b318-486f-b818-c41908029b8b service nova] Creating event network-changed:0bcd71a0-e429-40d7-b546-9eb4fc13e34a for instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 on hv-cinder-85226 Aug 10 12:39:01.419200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-f5fb32d1-e23d-48d4-93b0-cd22324f1fbd req-26067f71-b318-486f-b818-c41908029b8b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036468 Aug 10 12:39:01.420201 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 460/935] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:01.475699 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-291f387e-eacc-4f7c-9cb1-56e078e94d61 req-77743a57-5800-49a6-ad00-d7645906c575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2542450f-aa80-4cdc-a0f1-4e76c69906fd", "tag": "feaf6703-6902-4482-b882-6413ff5a2579"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:01.488800 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-291f387e-eacc-4f7c-9cb1-56e078e94d61 req-77743a57-5800-49a6-ad00-d7645906c575 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:01.489780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-291f387e-eacc-4f7c-9cb1-56e078e94d61 req-77743a57-5800-49a6-ad00-d7645906c575 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:01.490225 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-291f387e-eacc-4f7c-9cb1-56e078e94d61 req-77743a57-5800-49a6-ad00-d7645906c575 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:01.504732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-291f387e-eacc-4f7c-9cb1-56e078e94d61 req-77743a57-5800-49a6-ad00-d7645906c575 service nova] Creating event network-changed:feaf6703-6902-4482-b882-6413ff5a2579 for instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd on hv-cinder-85226 Aug 10 12:39:01.510022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-291f387e-eacc-4f7c-9cb1-56e078e94d61 req-77743a57-5800-49a6-ad00-d7645906c575 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039683 Aug 10 12:39:01.510623 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 476/936] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:02.225763 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:02.226464 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:02.233376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:02.233871 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:02.234308 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:02.235149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:02.235608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:02.236027 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:02.422299 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:02.431843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-515839ca-0b39-4a1e-bed9-cac2fb969799 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1314 microversion: 2.1 time: 0.210908 Aug 10 12:39:02.432387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 461/937] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:02 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:03.456276 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:03.457797 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:03.466054 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:03.466765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:03.467683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:03.469311 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:03.470092 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:03.470935 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:03.707236 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:03.714823 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-68325bb9-1b08-4594-9293-f93e3ff442f9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1314 microversion: 2.1 time: 0.263490 Aug 10 12:39:03.715397 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 477/938] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:03 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:04.736889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:04.737638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:04.745942 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:04.746538 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:04.746980 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:04.747690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:04.748263 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:04.749421 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:04.883418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:04.890767 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d4db6a74-6a1c-4044-8cfa-be85ec46b963 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1314 microversion: 2.1 time: 0.158724 Aug 10 12:39:04.891326 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 462/939] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:04 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:05.738005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-de35f4bb-1159-4964-a8eb-12a09141c469 req-9c56827f-2244-4e00-b8dd-3fe26978f8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2542450f-aa80-4cdc-a0f1-4e76c69906fd", "name": "network-vif-plugged", "status": "completed", "tag": "feaf6703-6902-4482-b882-6413ff5a2579"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:05.749443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-de35f4bb-1159-4964-a8eb-12a09141c469 req-9c56827f-2244-4e00-b8dd-3fe26978f8b2 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:05.749927 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-de35f4bb-1159-4964-a8eb-12a09141c469 req-9c56827f-2244-4e00-b8dd-3fe26978f8b2 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:05.750397 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-de35f4bb-1159-4964-a8eb-12a09141c469 req-9c56827f-2244-4e00-b8dd-3fe26978f8b2 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:05.761672 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-de35f4bb-1159-4964-a8eb-12a09141c469 req-9c56827f-2244-4e00-b8dd-3fe26978f8b2 service nova] Creating event network-vif-plugged:feaf6703-6902-4482-b882-6413ff5a2579 for instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd on hv-cinder-85226 Aug 10 12:39:05.766809 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-de35f4bb-1159-4964-a8eb-12a09141c469 req-9c56827f-2244-4e00-b8dd-3fe26978f8b2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032616 Aug 10 12:39:05.767390 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 478/940] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:05.912760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:05.913880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:05.924906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:05.925500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:05.926177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:05.927277 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:05.928512 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:05.929230 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:06.078712 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:06.086585 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1f052525-8160-4219-9e7b-32d2a1cc5bcd tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1314 microversion: 2.1 time: 0.179297 Aug 10 12:39:06.093311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 463/941] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:05 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:07.110533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:07.111231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:07.117466 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:07.117957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:07.118391 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:07.119093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:07.119549 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:07.119976 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:07.270433 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:07.278204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-341c23a1-5113-47e6-a31d-2e5759bb7d4a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1314 microversion: 2.1 time: 0.172460 Aug 10 12:39:07.278792 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 479/942] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:07 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:39:08.300090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:08.300818 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:08.308106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:08.308600 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:08.309030 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:08.309760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:08.310215 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:08.310636 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:08.445927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:08.454265 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fbb2c220-b535-4140-a5df-3b868142a870 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1498 microversion: 2.1 time: 0.158250 Aug 10 12:39:08.457391 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 464/943] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:08 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:09.207513 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:09.208011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:09.210477 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:09.215783 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:09.216254 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:09.216694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:09.217426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:09.217905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:09.218311 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:09.246227 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:39:09.319521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e3416214-5277-4a3e-a5db-326ba36ba52f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 204 len: 0 microversion: 2.1 time: 0.116032 Aug 10 12:39:09.320183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 480/944] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:39:09 2022] DELETE /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:39:09.330131 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:09.330734 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:09.332688 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:09.333354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:09.339485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:09.340250 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:09.340686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:09.341499 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:09.341959 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:09.342436 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:09.473526 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:09.481487 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-88418d6a-6f1f-4b23-ab8e-ed9b17d02e6f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1504 microversion: 2.1 time: 0.156122 Aug 10 12:39:09.482055 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 465/945] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:09 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:10.503204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:10.503895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:10.510083 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:10.510559 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:10.510987 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:10.511669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:10.512119 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:10.512539 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:10.643507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:10.651071 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0fdd02df-add8-425d-8838-699b4182cb70 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1504 microversion: 2.1 time: 0.152627 Aug 10 12:39:10.651634 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 481/946] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:10 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:11.672104 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:11.672782 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:11.675142 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:11.681920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:11.683087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:11.683738 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:11.684913 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:11.685703 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:11.686295 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:11.888969 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-ac9d55db-9afe-4bdb-94ca-e2f30e195912 req-5923ba71-b140-4eb9-b53b-7ca5556a470b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2542450f-aa80-4cdc-a0f1-4e76c69906fd", "name": "network-vif-deleted", "tag": "feaf6703-6902-4482-b882-6413ff5a2579"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:11.898272 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:11.907784 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:11.911793 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ac9d55db-9afe-4bdb-94ca-e2f30e195912 req-5923ba71-b140-4eb9-b53b-7ca5556a470b service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:11.912379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ac9d55db-9afe-4bdb-94ca-e2f30e195912 req-5923ba71-b140-4eb9-b53b-7ca5556a470b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:11.912887 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-ac9d55db-9afe-4bdb-94ca-e2f30e195912 req-5923ba71-b140-4eb9-b53b-7ca5556a470b service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:11.915646 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-43dc1249-8656-45da-9c58-4eb78e9af426 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 200 len: 1504 microversion: 2.1 time: 0.247271 Aug 10 12:39:11.916415 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 466/947] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:11 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:11.928998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-ac9d55db-9afe-4bdb-94ca-e2f30e195912 req-5923ba71-b140-4eb9-b53b-7ca5556a470b service nova] Creating event network-vif-deleted:feaf6703-6902-4482-b882-6413ff5a2579 for instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd on hv-cinder-85226 Aug 10 12:39:11.935335 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-ac9d55db-9afe-4bdb-94ca-e2f30e195912 req-5923ba71-b140-4eb9-b53b-7ca5556a470b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049933 Aug 10 12:39:11.936331 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 482/948] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:12.937227 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:12.938007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 2542450f-aa80-4cdc-a0f1-4e76c69906fd] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:12.945512 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:12.945996 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:12.946443 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:12.947156 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:12.947832 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:12.948274 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:12.962397 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] HTTP exception thrown: Instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd could not be found. Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Request method failure captured: Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd HTTP/1.1 Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86bgiDE8iZRNnDcVwwWkFiWWoOpAQkgiCfA3KJQ1wNeM8OthGvm10Sj4PNn2LTCvPio85sZKuwfYKHmyUtJCVjnCMasGUokdEYn2ZhfK0zc1RU3g5dfAFw2-UGWKlZXnJjBCvoisvMXXSPHjN_nj0-JcmG2JkIsiYVvezmXzo1a5mFM Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: afa4735b7c5b46bc9a0ca81f4733de00 Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesActionsTest-1520585002 Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:39:12.964087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/afa4735b7c5b46bc9a0ca81f4733de00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_afa4735b7c5b46bc9a0ca81f4733de00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/afa4735b7c5b46bc9a0ca81f4733de00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/afa4735b7c5b46bc9a0ca81f4733de00"}]}] Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesActionsTest-1520585002 Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: afa4735b7c5b46bc9a0ca81f4733de00 Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesActionsTest-1520585002 Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesActionsTest-1520585002-project Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9d593e55f72d4757886261b383e1794f Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesActionsTest-1520585002-project Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd could not be found. Aug 10 12:39:12.965817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '2542450f-aa80-4cdc-a0f1-4e76c69906fd'} Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd could not be found. Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:39:12.966713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd could not be found. Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd could not be found. Aug 10 12:39:12.968068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:12.969245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Returning 404 to user: Instance 2542450f-aa80-4cdc-a0f1-4e76c69906fd could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:39:12.969245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-20c06b94-8e8f-4c45-9e6c-2dcfb15ba27d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd" status: 404 len: 111 microversion: 2.1 time: 0.032403 Aug 10 12:39:12.969245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 467/949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:12 2022] GET /compute/v2.1/servers/2542450f-aa80-4cdc-a0f1-4e76c69906fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:39:13.077170 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1834744017", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "networks": [{"uuid": "dc107b9b-6365-4e19-9b21-085b02ba9b19"}]}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:13.148949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] validate_networks() for [('dc107b9b-6365-4e19-9b21-085b02ba9b19', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:39:13.519996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:39:13.520672 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:39:13.521153 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:39:13.521625 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:39:13.522042 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:39:13.532796 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:13.533327 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:13.533769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:13.534499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:13.534952 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:13.535377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:13.555621 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Getting quotas for project afa4735b7c5b46bc9a0ca81f4733de00. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:39:13.560143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Getting quotas for user 9d593e55f72d4757886261b383e1794f and project afa4735b7c5b46bc9a0ca81f4733de00. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:39:13.574735 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:39:13.577729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:39:13.629628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-65558e80-3e50-4299-b748-e94da827c0ff tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557288 Aug 10 12:39:13.630559 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 483/950] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:39:13.644945 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bfb2556d-8cf7-4e8d-946e-ce873e423df8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:13.645681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bfb2556d-8cf7-4e8d-946e-ce873e423df8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:13.705346 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bfb2556d-8cf7-4e8d-946e-ce873e423df8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:13.727449 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bfb2556d-8cf7-4e8d-946e-ce873e423df8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1214 microversion: 2.1 time: 0.090043 Aug 10 12:39:13.729413 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 468/951] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:13 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:14.748063 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:14.748685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:14.759228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:14.759730 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:14.760169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:14.761373 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:14.761839 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:14.762267 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:14.838060 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:14.846117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-2ff0f070-7d8b-4217-82e4-81a85534ef54 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1274 microversion: 2.1 time: 0.102132 Aug 10 12:39:14.846851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 484/952] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:14 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:15.868154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:15.868718 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:15.876604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:15.877074 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:15.877531 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:15.878223 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:15.878679 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:15.879097 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:16.010873 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:16.018271 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-31ebb8a8-f3ee-4d72-9323-bfcfdfb42726 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.154144 Aug 10 12:39:16.018836 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 469/953] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:15 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:16.177882 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-317778d7-60fc-4504-9084-4a7e8ec3aece req-840113c5-78e4-4620-bd73-55681ed30f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f12081-14f7-4b05-9086-7ed8ea7e592a", "tag": "b6677c65-e6eb-4c06-8f18-c5665f8a5405"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:16.187597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-317778d7-60fc-4504-9084-4a7e8ec3aece req-840113c5-78e4-4620-bd73-55681ed30f2f service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:16.188076 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-317778d7-60fc-4504-9084-4a7e8ec3aece req-840113c5-78e4-4620-bd73-55681ed30f2f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:16.189081 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-317778d7-60fc-4504-9084-4a7e8ec3aece req-840113c5-78e4-4620-bd73-55681ed30f2f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:16.193054 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:16.200580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-317778d7-60fc-4504-9084-4a7e8ec3aece req-840113c5-78e4-4620-bd73-55681ed30f2f service nova] Creating event network-changed:b6677c65-e6eb-4c06-8f18-c5665f8a5405 for instance 87f12081-14f7-4b05-9086-7ed8ea7e592a on hv-cinder-85226 Aug 10 12:39:16.205757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-317778d7-60fc-4504-9084-4a7e8ec3aece req-840113c5-78e4-4620-bd73-55681ed30f2f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031507 Aug 10 12:39:16.206620 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 485/954] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:17.039183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:17.039805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:17.046146 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:17.046628 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:17.047062 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:17.048360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:17.048835 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:17.049287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:17.175856 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:17.183133 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-57bab4d3-ef5f-48b2-87c0-807c09d1748a tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.147759 Aug 10 12:39:17.183638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 470/955] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:17 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:18.204307 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:18.205007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:18.212244 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:18.212731 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:18.213172 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:18.213890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:18.214344 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:18.214772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:18.362655 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:18.370662 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-52b9cd38-e642-4eea-ba82-00530e2396e5 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.171289 Aug 10 12:39:18.371521 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 486/956] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:18 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:19.391744 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:19.392348 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:19.398729 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:19.399203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:19.399634 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:19.400315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:19.400769 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:19.401192 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:19.530479 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:19.538366 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5f7f97f4-6d45-4504-8ce3-685fc1db6743 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.150493 Aug 10 12:39:19.538934 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 471/957] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:19 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:20.559629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:20.560150 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:20.567093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:20.567577 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:20.568014 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:20.568706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:20.569167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:20.569617 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:20.701871 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:20.709044 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f0e1bd3d-13bf-4cad-8d47-4352735b9616 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.153379 Aug 10 12:39:20.709636 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 487/958] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:20 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:21.729690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:21.730793 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:21.737604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:21.738440 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:21.738931 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:21.739632 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:21.740095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:21.740524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:21.744637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=93 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:21.814280 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-0fbc8e85-daf2-4f7e-b6bc-36f53c9169a1 req-76d627a1-a816-4aa6-884c-343938bce6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f12081-14f7-4b05-9086-7ed8ea7e592a", "name": "network-vif-plugged", "status": "completed", "tag": "b6677c65-e6eb-4c06-8f18-c5665f8a5405"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:21.824692 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-0fbc8e85-daf2-4f7e-b6bc-36f53c9169a1 req-76d627a1-a816-4aa6-884c-343938bce6b7 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:21.825326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-0fbc8e85-daf2-4f7e-b6bc-36f53c9169a1 req-76d627a1-a816-4aa6-884c-343938bce6b7 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:21.825910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-0fbc8e85-daf2-4f7e-b6bc-36f53c9169a1 req-76d627a1-a816-4aa6-884c-343938bce6b7 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:21.838828 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-0fbc8e85-daf2-4f7e-b6bc-36f53c9169a1 req-76d627a1-a816-4aa6-884c-343938bce6b7 service nova] Creating event network-vif-plugged:b6677c65-e6eb-4c06-8f18-c5665f8a5405 for instance 87f12081-14f7-4b05-9086-7ed8ea7e592a on hv-cinder-85226 Aug 10 12:39:21.843627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-0fbc8e85-daf2-4f7e-b6bc-36f53c9169a1 req-76d627a1-a816-4aa6-884c-343938bce6b7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Aug 10 12:39:21.844566 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 488/959] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:21.887962 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:21.896205 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d8fb16ad-ff3f-4a12-beaa-321fc85d3f79 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.170614 Aug 10 12:39:21.896785 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 472/960] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:21 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:22.917623 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:22.918314 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:22.924395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:22.924880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:22.925336 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:22.926019 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:22.926472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:22.926892 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:23.053005 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:23.060280 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-38601df7-6d5b-4257-82a6-21ce61ab5f8c tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.147372 Aug 10 12:39:23.060838 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 489/961] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:22 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:24.081993 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:24.082595 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:24.084846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:24.090054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:24.090541 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:24.090966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:24.091650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:24.092108 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:24.092522 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:24.218403 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:24.226052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-19ba60eb-2073-4bb8-a5b0-af23e1875410 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.148589 Aug 10 12:39:24.226610 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 473/962] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:24 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:25.246264 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:25.246869 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:25.248974 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:25.249650 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=6 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:25.256258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:25.256738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:25.257170 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:25.257895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:25.258334 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:25.258757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:25.384866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:25.392832 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-98d0685c-2a64-4101-9f44-000e0af2112b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1314 microversion: 2.1 time: 0.150415 Aug 10 12:39:25.393414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 490/963] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:25 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:26.414116 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:26.414885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:26.421174 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:26.421698 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:26.422135 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:26.422824 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:26.423282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:26.423707 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:26.571950 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:26.583733 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fc67146a-79d0-4667-b78a-10e4f2e68346 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1498 microversion: 2.1 time: 0.174439 Aug 10 12:39:26.584300 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 474/964] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:26 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:27.263198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:27.263776 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:27.270422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:27.270997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:27.271507 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:27.272301 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:27.272829 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:27.273258 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:27.300026 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:39:27.381635 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-affbda57-5a1e-4303-a3dc-69ce9f7922f6 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "DELETE /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 204 len: 0 microversion: 2.1 time: 0.121655 Aug 10 12:39:27.382382 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 491/965] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:39:27 2022] DELETE /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:39:27.390979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:27.391770 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:27.397701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:27.398189 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:27.398626 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:27.399315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:27.399776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:27.400201 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:27.525936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:27.533294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-715e6483-29db-4f31-b8ce-4be234bf223f tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1504 microversion: 2.1 time: 0.146443 Aug 10 12:39:27.534354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 475/966] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:27 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:39:28.555585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:28.556285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:28.562754 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:28.563235 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:28.563670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:28.564406 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:28.564888 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:28.565501 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:28.745840 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:28.754135 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-9aa0f444-2ce3-4ec2-a8e8-d31169a366b9 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1504 microversion: 2.1 time: 0.202507 Aug 10 12:39:28.754940 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 492/967] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:28 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:39:29.685777 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-5b1a0c42-1562-4833-981b-28f604af2555 req-d6646372-47f7-4116-9783-0902466d3ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f12081-14f7-4b05-9086-7ed8ea7e592a", "name": "network-vif-deleted", "tag": "b6677c65-e6eb-4c06-8f18-c5665f8a5405"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:29.698822 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-5b1a0c42-1562-4833-981b-28f604af2555 req-d6646372-47f7-4116-9783-0902466d3ed4 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:29.699302 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-5b1a0c42-1562-4833-981b-28f604af2555 req-d6646372-47f7-4116-9783-0902466d3ed4 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:29.699808 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-5b1a0c42-1562-4833-981b-28f604af2555 req-d6646372-47f7-4116-9783-0902466d3ed4 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:29.710802 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-5b1a0c42-1562-4833-981b-28f604af2555 req-d6646372-47f7-4116-9783-0902466d3ed4 service nova] Creating event network-vif-deleted:b6677c65-e6eb-4c06-8f18-c5665f8a5405 for instance 87f12081-14f7-4b05-9086-7ed8ea7e592a on hv-cinder-85226 Aug 10 12:39:29.715722 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-5b1a0c42-1562-4833-981b-28f604af2555 req-d6646372-47f7-4116-9783-0902466d3ed4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037014 Aug 10 12:39:29.716492 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 476/968] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:29.778428 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:29.779116 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:29.796515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:29.796739 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:29.797516 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:29.798456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:29.799001 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:29.799738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:29.834748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:29.835148 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:29.835585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:29.836029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lazy-loading 'fault' on Instance uuid 87f12081-14f7-4b05-9086-7ed8ea7e592a {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:39:29.883127 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:29.890645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6b920aa0-7bac-4268-bd80-8a17e36d3f2b tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1304 microversion: 2.1 time: 0.116841 Aug 10 12:39:29.891205 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 493/969] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:29 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:30.913877 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:30.914626 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:30.924015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:30.924015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:30.924015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:30.924015 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:30.924368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:30.924368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:30.954200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:30.954699 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:30.955139 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:30.955584 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lazy-loading 'fault' on Instance uuid 87f12081-14f7-4b05-9086-7ed8ea7e592a {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:39:30.998570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:31.006087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a0693544-2af9-4fba-936b-74d2fa43b5e8 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1304 microversion: 2.1 time: 0.097832 Aug 10 12:39:31.006676 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 477/970] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:30 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:32.026916 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:32.027531 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:32.034491 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:32.034977 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:32.035414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:32.036136 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:32.036589 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:32.037014 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:32.068284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:32.068758 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:32.069195 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:32.069665 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lazy-loading 'fault' on Instance uuid 87f12081-14f7-4b05-9086-7ed8ea7e592a {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:39:32.109081 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d593e55f72d4757886261b383e1794f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa4735b7c5b46bc9a0ca81f4733de00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:32.116963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b90ac5f8-3e13-4fd3-98e6-71160360093d tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 200 len: 1304 microversion: 2.1 time: 0.093928 Aug 10 12:39:32.117554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 494/971] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:32 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:33.137558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:33.138371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] [instance: 87f12081-14f7-4b05-9086-7ed8ea7e592a] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:33.144891 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:33.145476 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:33.145909 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:33.146609 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:33.147064 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:33.147483 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:33.160904 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] HTTP exception thrown: Instance 87f12081-14f7-4b05-9086-7ed8ea7e592a could not be found. Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Request method failure captured: Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a HTTP/1.1 Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86bgiDE8iZRNnDcVwwWkFiWWoOpAQkgiCfA3KJQ1wNeM8OthGvm10Sj4PNn2LTCvPio85sZKuwfYKHmyUtJCVjnCMasGUokdEYn2ZhfK0zc1RU3g5dfAFw2-UGWKlZXnJjBCvoisvMXXSPHjN_nj0-JcmG2JkIsiYVvezmXzo1a5mFM Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: afa4735b7c5b46bc9a0ca81f4733de00 Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-VolumesActionsTest-1520585002 Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:39:33.162558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/afa4735b7c5b46bc9a0ca81f4733de00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_afa4735b7c5b46bc9a0ca81f4733de00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/afa4735b7c5b46bc9a0ca81f4733de00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/afa4735b7c5b46bc9a0ca81f4733de00"}]}] Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-VolumesActionsTest-1520585002 Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: afa4735b7c5b46bc9a0ca81f4733de00 Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-VolumesActionsTest-1520585002 Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-VolumesActionsTest-1520585002-project Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 9d593e55f72d4757886261b383e1794f Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-VolumesActionsTest-1520585002-project Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 87f12081-14f7-4b05-9086-7ed8ea7e592a could not be found. Aug 10 12:39:33.164048 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '87f12081-14f7-4b05-9086-7ed8ea7e592a'} Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f12081-14f7-4b05-9086-7ed8ea7e592a could not be found. Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:39:33.164805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f12081-14f7-4b05-9086-7ed8ea7e592a could not be found. Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f12081-14f7-4b05-9086-7ed8ea7e592a could not be found. Aug 10 12:39:33.166194 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:39:33.167308 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] Returning 404 to user: Instance 87f12081-14f7-4b05-9086-7ed8ea7e592a could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:39:33.167308 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-58d904c1-b198-46e8-aacc-2e1d8eb1dc53 tempest-VolumesActionsTest-1520585002 tempest-VolumesActionsTest-1520585002-project] 10.222.0.65 "GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a" status: 404 len: 111 microversion: 2.1 time: 0.030362 Aug 10 12:39:33.167308 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 478/972] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:33 2022] GET /compute/v2.1/servers/87f12081-14f7-4b05-9086-7ed8ea7e592a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:39:33.243306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:33.244329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:33.250816 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:33.251300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:33.251742 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:33.252486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:33.252956 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:33.253468 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:33.435866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:39:33.521510 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-994c3afa-1a53-487f-8202-e64ff75c0679 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "DELETE /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 204 len: 0 microversion: 2.1 time: 0.282028 Aug 10 12:39:33.525093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 495/973] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:39:33 2022] DELETE /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:39:33.530482 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:33.531106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:33.537990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:33.539010 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:33.539449 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:33.540566 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:33.541191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:33.541903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:33.705816 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:33.713767 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1e673d28-0f4f-4f77-aab8-b257482ccfe0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1579 microversion: 2.1 time: 0.187328 Aug 10 12:39:33.714320 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 479/974] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:33 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1579 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:34.735324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:34.736015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:34.742894 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:34.743371 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:34.743798 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:34.744480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:34.744929 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:34.745379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:34.876937 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:34.884913 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-45677bc3-6b9d-46b0-9516-8d2dbb555b34 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1579 microversion: 2.1 time: 0.153774 Aug 10 12:39:34.885486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 496/975] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:34 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:35.905712 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:35.906324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:35.912872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:35.913396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:35.913838 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:35.914523 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:35.914976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:35.915400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:36.052121 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:36.059678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-add4ac86-7379-426f-8496-ed4f07bc8e42 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1579 microversion: 2.1 time: 0.157839 Aug 10 12:39:36.060236 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 480/976] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:35 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:37.079725 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:37.080336 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:37.088847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:37.089376 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:37.089813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:37.090567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:37.091020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:37.091452 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:37.231200 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:37.239123 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-25e12b0f-a19a-422c-b126-2cef27d6bc75 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1579 microversion: 2.1 time: 0.163073 Aug 10 12:39:37.239633 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 497/977] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:37 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:38.258694 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:38.259305 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:38.265740 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:38.266167 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:38.266604 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:38.267293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:38.267751 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:38.268177 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:38.397644 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:38.404999 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d3b5632e-593c-4b3b-9e81-0ca4f2f0c3a8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1579 microversion: 2.1 time: 0.150092 Aug 10 12:39:38.405609 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 481/978] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:38 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1579 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:39.428836 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:39.429414 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:39.435877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:39.436373 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:39.436817 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:39.437547 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:39.438014 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:39.438443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:39.569399 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:39.576978 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-51f6ed47-7660-4e20-9f5a-f5f23e62adb2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1579 microversion: 2.1 time: 0.152611 Aug 10 12:39:39.577577 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 498/979] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:39 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:40.599056 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:40.599458 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:40.605690 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:40.606181 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:40.606620 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:40.607312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:40.607768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:40.608195 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:40.741024 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:40.748503 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c03e2dfd-766f-486e-896e-f973f59281c7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1579 microversion: 2.1 time: 0.154132 Aug 10 12:39:40.749068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 482/980] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:40 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:41.770884 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:41.771538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:41.777833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:41.778319 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:41.778757 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:41.779459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:41.779917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:41.780341 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:41.783048 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:42.031939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:42.039644 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b127edbb-8d8b-4264-a3c9-ca649234475c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1579 microversion: 2.1 time: 0.273213 Aug 10 12:39:42.040289 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 499/981] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:41 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1579 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:42.496329 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-e7e8963b-10a6-4bd9-b3a3-9614186dbd05 req-f4fedf3a-924f-4fd0-9675-f5457e3adfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461c4836-f025-459c-9295-0a840e0e2066", "name": "network-vif-deleted", "tag": "78d3316e-f954-4f65-8766-835c8e8a9708"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:42.502386 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=38 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:42.508537 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e7e8963b-10a6-4bd9-b3a3-9614186dbd05 req-f4fedf3a-924f-4fd0-9675-f5457e3adfed service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:42.509160 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e7e8963b-10a6-4bd9-b3a3-9614186dbd05 req-f4fedf3a-924f-4fd0-9675-f5457e3adfed service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:42.509627 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e7e8963b-10a6-4bd9-b3a3-9614186dbd05 req-f4fedf3a-924f-4fd0-9675-f5457e3adfed service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:42.521234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-e7e8963b-10a6-4bd9-b3a3-9614186dbd05 req-f4fedf3a-924f-4fd0-9675-f5457e3adfed service nova] Creating event network-vif-deleted:78d3316e-f954-4f65-8766-835c8e8a9708 for instance 461c4836-f025-459c-9295-0a840e0e2066 on hv-cinder-85226 Aug 10 12:39:42.526155 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-e7e8963b-10a6-4bd9-b3a3-9614186dbd05 req-f4fedf3a-924f-4fd0-9675-f5457e3adfed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033719 Aug 10 12:39:42.526730 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 483/982] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:43.061040 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:43.061684 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:43.063960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:43.070113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:43.070598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:43.071043 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:43.071733 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:43.072188 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:43.072619 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:43.149933 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:43.158394 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7504762c-97f8-44f3-89f0-ccef7076450d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1511 microversion: 2.1 time: 0.101106 Aug 10 12:39:43.159038 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 500/983] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:43 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:44.180883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:44.181609 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:44.187735 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:44.188226 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:44.188702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:44.189441 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:44.189905 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:44.190334 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:44.221248 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:44.221755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:44.222196 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:44.222656 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lazy-loading 'fault' on Instance uuid 461c4836-f025-459c-9295-0a840e0e2066 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:39:44.263022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:44.270964 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ba4c79f0-35c6-46cc-84b9-d1955af3b5b3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 200 len: 1231 microversion: 2.1 time: 0.094152 Aug 10 12:39:44.271626 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 484/984] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:44 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:45.292242 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:45.292886 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:45.299793 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:45.300332 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:45.300845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:45.301747 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:45.302349 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:45.302879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:45.317819 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] HTTP exception thrown: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Request method failure captured: Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 HTTP/1.1 Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86ZVo2naWqRa6EgkaO0N3U0jGxscmrM8SE6xCQ7zJ91Z_j4Wo7X_lIDHTXj7cEynX5g0vyRBMSIUVvxyusFnlYsMLvR2zURJsFNuFZ-Y4FcM9KB4i-DCGyWDsJE5SxsgYlcldCchISsTEYwI87txMJboQUY64fqoDrG25NaxpG4-U0A Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:39:45.319480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}] Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-TestVolumeBootPattern-452380591 Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 770127af5f494b7e9198438441868fa1 Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:39:45.321177 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '461c4836-f025-459c-9295-0a840e0e2066'} Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:39:45.322383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:39:45.323954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:39:45.325434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Returning 404 to user: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:39:45.325434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-cd639369-130e-43ea-a0d8-279fe0231035 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 404 len: 111 microversion: 2.1 time: 0.032569 Aug 10 12:39:45.325434 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 501/985] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:45 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:39:45.422474 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1582156806", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1160807107", "security_groups": [{"name": "tempest-secgroup-smoke-1740254587"}], "block_device_mapping_v2": [{"uuid": "2daee43e-80a2-4768-9a28-316fc19d7aa1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ce24948c-b056-4a3f-868d-8498edb8d6bb"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:45.543462 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] validate_networks() for [('ce24948c-b056-4a3f-868d-8498edb8d6bb', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:39:45.941293 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:39:45.941849 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:39:45.942927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:39:45.943349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:39:45.944028 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:39:45.953189 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:45.953713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:45.954160 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:45.954882 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:45.955582 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:45.956018 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:45.972900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Getting quotas for project f63c30b5d2af4144b096b78c7ab308a7. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:39:45.976795 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Getting quotas for user 770127af5f494b7e9198438441868fa1 and project f63c30b5d2af4144b096b78c7ab308a7. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:39:46.036001 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:39:46.038101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2daee43e-80a2-4768-9a28-316fc19d7aa1',volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:39:46.181464 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-300086a1-d410-4c45-928e-9fe9b5519bbf tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763173 Aug 10 12:39:46.182268 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 485/986] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:39:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:39:46.194048 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-09e0221d-8b3f-49ce-a9fa-e9fb3c17a319 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:46.194949 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-09e0221d-8b3f-49ce-a9fa-e9fb3c17a319 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:46.266945 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-09e0221d-8b3f-49ce-a9fa-e9fb3c17a319 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:46.274164 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-09e0221d-8b3f-49ce-a9fa-e9fb3c17a319 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1095 microversion: 2.1 time: 0.084725 Aug 10 12:39:46.276379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 502/987] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:46 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:47.295739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:47.296971 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:47.304086 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:47.304609 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:47.305053 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:47.305796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:47.306243 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:47.306668 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:47.373998 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:47.382166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5c1b044f-7fc3-49bd-ae74-72b6d9a306f0 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1193 microversion: 2.1 time: 0.091186 Aug 10 12:39:47.383009 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 486/988] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:47 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:48.404229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:48.406126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:48.450341 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:48.454996 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:48.456714 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:48.463448 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:48.468708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:48.480594 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:48.965997 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:48.975602 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c59f6eeb-60ab-451f-9092-d5d590512bda tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1279 microversion: 2.1 time: 0.576423 Aug 10 12:39:48.989358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 503/989] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:48 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1279 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:49.996986 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:49.998287 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:50.005436 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:50.006148 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:50.006808 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:50.007810 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:50.008511 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:50.009110 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:50.181684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:50.189087 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-88813132-3122-42f0-a654-45d021f89593 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.196667 Aug 10 12:39:50.202559 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 487/990] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:49 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:51.209630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:51.210235 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:51.216535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:51.217014 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:51.217481 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:51.218165 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:51.218619 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:51.219041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:51.351592 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:51.358794 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-06c7d099-aad9-45e7-8b97-f1d5abcaa0f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.153585 Aug 10 12:39:51.359345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 504/991] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:51 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:52.248990 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-71f6cff8-06d3-4ceb-8c80-7a786d9ec3de req-80c6270a-bcbf-4cd6-a764-df59632bd43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c86ad14-7c49-41a0-b663-eea08e579aa6", "tag": "850b26e9-2603-4ccd-84ec-00ede7dfd424"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:52.260824 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-71f6cff8-06d3-4ceb-8c80-7a786d9ec3de req-80c6270a-bcbf-4cd6-a764-df59632bd43a service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:52.261780 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-71f6cff8-06d3-4ceb-8c80-7a786d9ec3de req-80c6270a-bcbf-4cd6-a764-df59632bd43a service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:52.262529 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-71f6cff8-06d3-4ceb-8c80-7a786d9ec3de req-80c6270a-bcbf-4cd6-a764-df59632bd43a service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:52.275781 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=84 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:52.278456 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-71f6cff8-06d3-4ceb-8c80-7a786d9ec3de req-80c6270a-bcbf-4cd6-a764-df59632bd43a service nova] Creating event network-changed:850b26e9-2603-4ccd-84ec-00ede7dfd424 for instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 on hv-cinder-85226 Aug 10 12:39:52.284273 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-71f6cff8-06d3-4ceb-8c80-7a786d9ec3de req-80c6270a-bcbf-4cd6-a764-df59632bd43a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039524 Aug 10 12:39:52.285739 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 488/992] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:52.381074 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:52.382037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:52.394604 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:52.395813 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:52.396176 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:52.397303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:52.397992 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:52.398653 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:52.661603 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:52.670647 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a1240ba7-3fd0-4b4d-80ef-978eb0ff28d4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.294784 Aug 10 12:39:52.678800 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 505/993] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:52 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:52.787255 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1584180071", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "networks": [{"uuid": "882fe220-2031-4c74-86e0-f50bf01ee472"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:52.865998 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] validate_networks() for [('882fe220-2031-4c74-86e0-f50bf01ee472', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:39:53.321772 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:39:53.322487 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:39:53.322666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:39:53.323267 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:39:53.323843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:39:53.337453 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:53.337976 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:53.338668 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:53.339586 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:53.340214 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:53.340823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:53.360484 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Getting quotas for project f797ec18d0a847748116b1dd18bc8cf1. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:39:53.365639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Getting quotas for user 41879b8ab41b49f79ad7f8ae4871f251 and project f797ec18d0a847748116b1dd18bc8cf1. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:39:53.377719 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:39:53.381043 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:39:53.428973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8abfe23c-4d6a-4bb0-9da6-32a3c9857ffe tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646131 Aug 10 12:39:53.429974 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 489/994] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:39:53.440187 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-dca2a1f9-f037-44bb-b430-8849c46d3f58 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:53.441293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-dca2a1f9-f037-44bb-b430-8849c46d3f58 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:53.525790 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-dca2a1f9-f037-44bb-b430-8849c46d3f58 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:53.535072 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-dca2a1f9-f037-44bb-b430-8849c46d3f58 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1219 microversion: 2.1 time: 0.098425 Aug 10 12:39:53.549533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 506/995] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:53 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:53.698769 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:53.699762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:53.712638 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:53.718242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:53.719051 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:53.720054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:53.721168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:53.721860 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:53.964753 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:53.978149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-705972d0-1edd-4f10-9c76-412ddcf01075 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.283820 Aug 10 12:39:53.978825 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 490/996] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:53 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:54.556188 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:54.557588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:54.564657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:54.566051 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:54.567380 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:54.568293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:54.568848 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:54.569770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:54.669071 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:54.677016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-57090e89-d2b7-4c15-bce7-e8e6a383ca1a tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1271 microversion: 2.1 time: 0.124901 Aug 10 12:39:54.677616 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 507/997] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:54 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:54.998875 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:54.999477 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:55.008011 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:55.008757 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:55.009282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:55.011816 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:55.012449 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:55.012984 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:55.187369 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:55.203835 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2d019908-e2a2-4e81-8182-e548a16b9b86 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.207991 Aug 10 12:39:55.216097 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 491/998] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:54 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:55.703900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:55.704580 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:55.721300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:55.722077 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:55.722531 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:55.723825 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:55.726567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:55.727015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:56.002910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:56.012467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e48898e7-721e-4f5c-86e9-e852c48f4551 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1319 microversion: 2.1 time: 0.316586 Aug 10 12:39:56.014093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 508/999] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:55 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:56.231525 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:56.232347 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:56.241608 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:56.242476 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:56.242913 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:56.243845 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:56.244263 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:56.245410 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:56.393732 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-6df951f2-ccb2-425d-a536-9af8c62f5f45 req-be059dfb-13b1-42d1-ab1a-3fa15c154d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecda8431-98cd-4df9-9b7e-1a046259560c", "tag": "ed67cab4-c8c9-4696-930a-fdaa179a21be"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:39:56.427697 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6df951f2-ccb2-425d-a536-9af8c62f5f45 req-be059dfb-13b1-42d1-ab1a-3fa15c154d86 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:56.429541 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6df951f2-ccb2-425d-a536-9af8c62f5f45 req-be059dfb-13b1-42d1-ab1a-3fa15c154d86 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:56.430457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-6df951f2-ccb2-425d-a536-9af8c62f5f45 req-be059dfb-13b1-42d1-ab1a-3fa15c154d86 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:56.444754 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:56.453947 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-6df951f2-ccb2-425d-a536-9af8c62f5f45 req-be059dfb-13b1-42d1-ab1a-3fa15c154d86 service nova] Creating event network-changed:ed67cab4-c8c9-4696-930a-fdaa179a21be for instance ecda8431-98cd-4df9-9b7e-1a046259560c on hv-cinder-85226 Aug 10 12:39:56.461723 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-6df951f2-ccb2-425d-a536-9af8c62f5f45 req-be059dfb-13b1-42d1-ab1a-3fa15c154d86 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073459 Aug 10 12:39:56.463250 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 509/1000] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:39:56.463783 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0714c1d0-9fc7-4ca0-b1dd-fec7160fd67b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.235498 Aug 10 12:39:56.472617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 492/1001] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:56 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:57.036249 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:57.036974 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:57.045556 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:57.046288 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:57.046654 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:57.047484 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:57.048070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:57.048678 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:57.193708 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:57.206219 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3c57db85-1f30-47d9-88f6-a1b9ebd8ffc0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1319 microversion: 2.1 time: 0.174057 Aug 10 12:39:57.206921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 510/1002] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:57 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:57.490510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:57.490510 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:57.499079 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:57.499727 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:57.500471 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:57.501360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:57.502084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:57.502597 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:57.688513 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:57.696550 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3ad3f62e-937d-4989-8be8-156b81232e2d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.211510 Aug 10 12:39:57.697884 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 493/1003] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:57 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:58.229379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:58.232069 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:58.243065 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:58.244329 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:58.245597 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:58.247198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:58.248661 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:58.249799 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:58.509426 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:58.520982 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-863c3e1f-6513-46c2-a20c-a2ba0e4e964c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1319 microversion: 2.1 time: 0.297663 Aug 10 12:39:58.524836 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 511/1004] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:58 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:58.719474 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:58.720656 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:58.730335 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:58.731079 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:58.731756 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:58.732634 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:58.733310 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:58.733904 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:58.882322 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:58.894209 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-133e2175-c470-4f0b-8831-01b63640bbe5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.178296 Aug 10 12:39:58.894906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 494/1005] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:58 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:59.543098 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:59.543736 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:59.550830 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:59.551998 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:59.552461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:59.553438 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:59.553901 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:59.554324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:59.701919 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:39:59.709984 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-bfc7e74d-c2ae-4447-83c8-d99518315388 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1319 microversion: 2.1 time: 0.170934 Aug 10 12:39:59.710778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 512/1006] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:59 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:39:59.917537 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:59.918919 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:39:59.925726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:59.926988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:59.927429 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:59.928132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:59.928590 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:59.929020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:00.073983 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:00.082841 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-cf987297-a4a4-40ec-951d-c0cfecfc0dbb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.168860 Aug 10 12:40:00.083850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 495/1007] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:39:59 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:00.738071 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:00.740585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:00.755890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:00.756946 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:00.758514 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:00.759525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:00.760240 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:00.761242 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:00.918461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:00.926833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-5d78f7a0-de4e-4d2f-aec6-8a641a11ff66 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1319 microversion: 2.1 time: 0.197744 Aug 10 12:40:00.927469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 513/1008] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:00 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:01.110206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:01.111002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:01.120241 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:01.120663 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:01.121104 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:01.122494 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:01.122964 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:01.123397 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:01.273136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:01.281103 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8d5a3aa8-19d0-4cb4-978e-5d33bea2d34f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.174749 Aug 10 12:40:01.281685 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 496/1009] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:01 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:01.950482 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:01.952169 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:01.962943 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:01.964523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:01.965285 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:01.966212 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:01.966845 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:01.967448 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:02.177729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:02.187670 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-fe366f3d-e0bb-4ef4-a307-51a84398d85f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1319 microversion: 2.1 time: 0.242953 Aug 10 12:40:02.188433 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 514/1010] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:01 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:02.302096 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:02.302713 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:02.312236 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:02.312875 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:02.313648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:02.315503 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:02.316551 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:02.317463 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:02.423574 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-fdad1f0b-b6de-4436-91b2-3365ddff4cdd req-b64e9a85-224a-4a71-8781-64a19901b905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecda8431-98cd-4df9-9b7e-1a046259560c", "name": "network-vif-plugged", "status": "completed", "tag": "ed67cab4-c8c9-4696-930a-fdaa179a21be"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:40:02.437495 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-fdad1f0b-b6de-4436-91b2-3365ddff4cdd req-b64e9a85-224a-4a71-8781-64a19901b905 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:02.437990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-fdad1f0b-b6de-4436-91b2-3365ddff4cdd req-b64e9a85-224a-4a71-8781-64a19901b905 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:02.438429 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-fdad1f0b-b6de-4436-91b2-3365ddff4cdd req-b64e9a85-224a-4a71-8781-64a19901b905 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:02.470303 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-fdad1f0b-b6de-4436-91b2-3365ddff4cdd req-b64e9a85-224a-4a71-8781-64a19901b905 service nova] Creating event network-vif-plugged:ed67cab4-c8c9-4696-930a-fdaa179a21be for instance ecda8431-98cd-4df9-9b7e-1a046259560c on hv-cinder-85226 Aug 10 12:40:02.479977 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-fdad1f0b-b6de-4436-91b2-3365ddff4cdd req-b64e9a85-224a-4a71-8781-64a19901b905 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060225 Aug 10 12:40:02.481449 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 515/1011] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:40:02.543273 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:02.561421 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9a6c9d1f-1ba3-4405-be05-06e3a432cb90 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.263097 Aug 10 12:40:02.562276 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 497/1012] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:02 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:03.211007 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:03.211699 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:03.217851 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:03.218339 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:03.218775 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:03.219466 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:03.219921 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:03.220345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:03.364361 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:03.372149 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b4a2325c-d5a0-44ef-878f-da1bb4917d78 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1319 microversion: 2.1 time: 0.165870 Aug 10 12:40:03.372908 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 516/1013] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:03 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:03.587854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:03.590300 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:03.605203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=4 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:03.606380 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=12 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:03.611790 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:03.612473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:03.612979 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:03.614100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:03.615095 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:03.615919 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:03.775761 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:03.784167 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dd3abd10-ecdb-484f-902c-e48424d7844b tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.203460 Aug 10 12:40:03.784749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 498/1014] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:03 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:04.396641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:04.397216 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:04.399220 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=4 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:04.405480 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:04.406000 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:04.406448 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:04.407153 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:04.407616 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:04.408049 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:04.498821 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-e9a68b5c-fae6-42cf-a55d-cf2048ef4442 req-fa465c99-00a9-4198-8e3f-084152358e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c86ad14-7c49-41a0-b663-eea08e579aa6", "name": "network-vif-plugged", "status": "completed", "tag": "850b26e9-2603-4ccd-84ec-00ede7dfd424"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:40:04.509111 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e9a68b5c-fae6-42cf-a55d-cf2048ef4442 req-fa465c99-00a9-4198-8e3f-084152358e60 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:04.509745 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e9a68b5c-fae6-42cf-a55d-cf2048ef4442 req-fa465c99-00a9-4198-8e3f-084152358e60 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:04.510430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-e9a68b5c-fae6-42cf-a55d-cf2048ef4442 req-fa465c99-00a9-4198-8e3f-084152358e60 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:04.523765 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-e9a68b5c-fae6-42cf-a55d-cf2048ef4442 req-fa465c99-00a9-4198-8e3f-084152358e60 service nova] Creating event network-vif-plugged:850b26e9-2603-4ccd-84ec-00ede7dfd424 for instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 on hv-cinder-85226 Aug 10 12:40:04.530212 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-e9a68b5c-fae6-42cf-a55d-cf2048ef4442 req-fa465c99-00a9-4198-8e3f-084152358e60 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035042 Aug 10 12:40:04.530935 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 499/1015] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:40:04.546956 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:04.554481 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ceff585e-3793-4590-91b0-8a9f1aa561a0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1319 microversion: 2.1 time: 0.162145 Aug 10 12:40:04.555094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 517/1016] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:04 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:04.804922 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:04.805656 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:04.812336 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:04.812823 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:04.813280 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:04.813989 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:04.814457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:04.814885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:04.946428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:04.954052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7d4b21bf-b5e4-4997-991e-9008c4165ef6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.153288 Aug 10 12:40:04.954622 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 500/1017] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:04 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:05.574701 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:05.575412 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:05.582047 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:05.582530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:05.582967 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:05.583714 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:05.584167 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:05.584588 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:05.711499 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:05.718966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-57cc6d8a-b20c-4063-b6b3-418504c5f822 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1508 microversion: 2.1 time: 0.148070 Aug 10 12:40:05.719525 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 518/1018] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:05 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:05.975123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:05.976321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:05.982530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:05.983022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:05.983643 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:05.984354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:05.984814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:05.985250 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:06.129619 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:06.139022 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-a9c47cdb-ae72-4246-9f10-368576aed615 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1267 microversion: 2.1 time: 0.167775 Aug 10 12:40:06.139676 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 501/1019] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:05 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:07.159750 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:07.160410 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:07.167538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:07.170754 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:07.171443 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:07.174837 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:07.175568 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:07.176119 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:07.410166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:07.412489 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=100 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:07.423360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-aa1e4e28-809c-43a8-96bc-8affc9898aab tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1454 microversion: 2.1 time: 0.267337 Aug 10 12:40:07.424259 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 519/1020] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:07 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1454 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:07.444759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:07.446561 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:07.453082 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:07.453827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:07.454265 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:07.454966 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:07.455423 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:07.455880 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:07.602567 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:07.610154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-9bae3380-2f9c-49a1-b1b1-19db72a0f44f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1454 microversion: 2.1 time: 0.170121 Aug 10 12:40:07.610755 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 502/1021] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:07 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:09.553725 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-83fffe78-aabc-4ea6-83e4-071fdba25a00 req-13867c98-c89a-48fa-933b-30e556c5b390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c86ad14-7c49-41a0-b663-eea08e579aa6", "tag": "850b26e9-2603-4ccd-84ec-00ede7dfd424"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:40:09.564436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-83fffe78-aabc-4ea6-83e4-071fdba25a00 req-13867c98-c89a-48fa-933b-30e556c5b390 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:09.565157 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-83fffe78-aabc-4ea6-83e4-071fdba25a00 req-13867c98-c89a-48fa-933b-30e556c5b390 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:09.565716 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-83fffe78-aabc-4ea6-83e4-071fdba25a00 req-13867c98-c89a-48fa-933b-30e556c5b390 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:09.589094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-83fffe78-aabc-4ea6-83e4-071fdba25a00 req-13867c98-c89a-48fa-933b-30e556c5b390 service nova] Creating event network-changed:850b26e9-2603-4ccd-84ec-00ede7dfd424 for instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 on hv-cinder-85226 Aug 10 12:40:09.594458 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-83fffe78-aabc-4ea6-83e4-071fdba25a00 req-13867c98-c89a-48fa-933b-30e556c5b390 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047845 Aug 10 12:40:09.595957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 520/1022] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:40:20.978957 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7126aaf3-5a08-4196-9908-5497b3d18e37", "device": "/dev/sdb"}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:40:20.981876 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:20.984448 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:20.985189 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=77 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:20.990382 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:20.990862 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:20.991296 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:20.991984 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:20.992437 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:20.992865 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:21.254352 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6718fdc8-a55c-452b-ab36-a4d9c0cfb59c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "POST /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279782 Aug 10 12:40:21.254982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 503/1023] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:40:20 2022] POST /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:40:44.914172 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=45 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:44.914902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:44.919528 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:44.920108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:44.927726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:44.928209 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:44.928646 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:44.929364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:44.929820 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:44.930245 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:45.008763 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lazy-loading 'services' on Instance uuid ecda8431-98cd-4df9-9b7e-1a046259560c {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:40:45.078713 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-eb425eab-6d35-4c4b-8347-3f8d1a70dbd0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c/os-volume_attachments/7126aaf3-5a08-4196-9908-5497b3d18e37" status: 202 len: 0 microversion: 2.1 time: 0.166065 Aug 10 12:40:45.079306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 521/1024] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:40:44 2022] DELETE /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c/os-volume_attachments/7126aaf3-5a08-4196-9908-5497b3d18e37 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:40:46.200124 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:46.200891 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:40:46.205457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:46.206037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:46.213483 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:46.213972 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:46.214406 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:46.215746 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:46.216206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:46.216631 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:46.241860 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:40:46.314528 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d0fb6a93-d7f7-4819-b283-8d74572ee72e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 204 len: 0 microversion: 2.1 time: 0.115948 Aug 10 12:40:46.315224 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 504/1025] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:40:46 2022] DELETE /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:40:46.325168 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:46.325986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:46.332327 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:46.332815 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:46.333250 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:46.334026 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:46.334461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:46.334893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:46.468225 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:46.475879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ac710dd0-2325-41be-ac4a-cb75722479cd tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1514 microversion: 2.1 time: 0.156155 Aug 10 12:40:46.476435 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 522/1026] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:46 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:47.497129 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:47.497874 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:47.504282 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:47.504708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:47.505144 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:47.505858 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:47.506313 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:47.506736 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:47.635923 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:47.643320 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3c4e6e03-eb8e-48f1-a370-a44c9b82f08c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1514 microversion: 2.1 time: 0.151033 Aug 10 12:40:47.643889 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 505/1027] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:47 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:40:48.664087 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:48.664627 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:48.670898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:48.671383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:48.672630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:48.673531 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:48.673991 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:48.675132 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:48.766215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:48.768504 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-ddf4853e-54eb-4121-bac1-977d2ab8fc87 req-759cc403-fbad-4f96-832c-e33226c1a49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecda8431-98cd-4df9-9b7e-1a046259560c", "name": "network-vif-deleted", "tag": "ed67cab4-c8c9-4696-930a-fdaa179a21be"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:40:48.774271 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0b7a974b-9525-45d8-b581-060375d4285f tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 200 len: 1472 microversion: 2.1 time: 0.114030 Aug 10 12:40:48.774925 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 523/1028] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:48 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 1472 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:48.786879 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ddf4853e-54eb-4121-bac1-977d2ab8fc87 req-759cc403-fbad-4f96-832c-e33226c1a49f service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:48.787354 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ddf4853e-54eb-4121-bac1-977d2ab8fc87 req-759cc403-fbad-4f96-832c-e33226c1a49f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:48.788430 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-ddf4853e-54eb-4121-bac1-977d2ab8fc87 req-759cc403-fbad-4f96-832c-e33226c1a49f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:48.800020 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-ddf4853e-54eb-4121-bac1-977d2ab8fc87 req-759cc403-fbad-4f96-832c-e33226c1a49f service nova] Creating event network-vif-deleted:ed67cab4-c8c9-4696-930a-fdaa179a21be for instance ecda8431-98cd-4df9-9b7e-1a046259560c on hv-cinder-85226 Aug 10 12:40:48.804910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-ddf4853e-54eb-4121-bac1-977d2ab8fc87 req-759cc403-fbad-4f96-832c-e33226c1a49f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040155 Aug 10 12:40:48.805549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 506/1029] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:40:49.796085 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:49.796693 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: ecda8431-98cd-4df9-9b7e-1a046259560c] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:49.803235 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:49.803712 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:49.804145 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:49.804832 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:49.805293 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:49.805721 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:49.818665 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] HTTP exception thrown: Instance ecda8431-98cd-4df9-9b7e-1a046259560c could not be found. Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Request method failure captured: Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c HTTP/1.1 Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86cV6t8efz-74e8CgsS13MWiw7C4hPoLP90Yk_iI6ghK3f9FGdIBua052KBHN-1MGvp0pqvkM6hzfqsxS0ba_wLjPLUPGNdvpbOTBhUuz-duzmN-KsM9NMOtD6ErDgWO49uc4G1uPGyW3U355QXbuicegVpdpcsjSPA3QbTWxnqM_j4 Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: f797ec18d0a847748116b1dd18bc8cf1 Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1327441136 Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:40:49.820278 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f797ec18d0a847748116b1dd18bc8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f797ec18d0a847748116b1dd18bc8cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f797ec18d0a847748116b1dd18bc8cf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f797ec18d0a847748116b1dd18bc8cf1"}]}] Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesSnapshotTestJSON-1327441136 Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: f797ec18d0a847748116b1dd18bc8cf1 Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1327441136 Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesSnapshotTestJSON-1327441136-project Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 41879b8ab41b49f79ad7f8ae4871f251 Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesSnapshotTestJSON-1327441136-project Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance ecda8431-98cd-4df9-9b7e-1a046259560c could not be found. Aug 10 12:40:49.821990 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': 'ecda8431-98cd-4df9-9b7e-1a046259560c'} Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecda8431-98cd-4df9-9b7e-1a046259560c could not be found. Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:40:49.822960 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecda8431-98cd-4df9-9b7e-1a046259560c could not be found. Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecda8431-98cd-4df9-9b7e-1a046259560c could not be found. Aug 10 12:40:49.824504 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:40:49.825957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Returning 404 to user: Instance ecda8431-98cd-4df9-9b7e-1a046259560c could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:40:49.825957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6d616990-f774-4bd2-85a9-ea2af5f3ac4d tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c" status: 404 len: 111 microversion: 2.1 time: 0.030030 Aug 10 12:40:49.825957 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 524/1030] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:49 2022] GET /compute/v2.1/servers/ecda8431-98cd-4df9-9b7e-1a046259560c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:40:57.634229 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1301770242", "imageRef": "f08421ae-4c8f-4d3c-9e9d-07d87087de31", "flavorRef": "452", "networks": [{"uuid": "882fe220-2031-4c74-86e0-f50bf01ee472"}]}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:40:57.685985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.network.neutron [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] validate_networks() for [('882fe220-2031-4c74-86e0-f50bf01ee472', None, None, None, None, None)] {{(pid=118381) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:40:58.020646 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Flavor limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:40:58.021069 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Image limits 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:40:58.021647 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Flavor pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:40:58.022060 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Image pref 0:0:0 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:40:58.022472 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.virt.hardware [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118381) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:40:58.031617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:58.032097 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:58.032531 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:58.033260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:58.033743 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:58.034166 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:58.050836 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Getting quotas for project f797ec18d0a847748116b1dd18bc8cf1. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:40:58.054692 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.quota [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Getting quotas for user 41879b8ab41b49f79ad7f8ae4871f251 and project f797ec18d0a847748116b1dd18bc8cf1. Resources: {'cores', 'instances', 'ram'} {{(pid=118381) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:40:58.065198 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Going to run 1 instances... {{(pid=118381) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:40:58.067519 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f08421ae-4c8f-4d3c-9e9d-07d87087de31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118381) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:40:58.113581 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3d5a29c6-26db-4fb7-8886-c26feaf8851e tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484200 Aug 10 12:40:58.114232 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 507/1031] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:40:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:40:58.124961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1303cab9-2b20-489a-8467-32afcb05cfe0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:58.125598 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1303cab9-2b20-489a-8467-32afcb05cfe0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:58.180319 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1303cab9-2b20-489a-8467-32afcb05cfe0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:58.187326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1303cab9-2b20-489a-8467-32afcb05cfe0 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1219 microversion: 2.1 time: 0.066334 Aug 10 12:40:58.187887 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 525/1032] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:58 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:40:59.209347 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:40:59.210632 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:40:59.217676 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:59.218163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:59.218603 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:59.219532 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:59.219992 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:59.220670 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:59.284951 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:40:59.293456 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b33afb5d-362b-47ec-9143-755d26778f5c tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1289 microversion: 2.1 time: 0.090263 Aug 10 12:40:59.294748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 508/1033] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:40:59 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:00.314887 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:00.315519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:00.317999 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:00.324137 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:00.324617 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:00.325049 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:00.326408 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:00.326859 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:00.327284 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:00.436996 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-f6d9e86c-2c7a-4049-9441-879381abae28 req-30655c9e-d687-4046-9d9b-dcf574bbadca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4499ffdb-91e6-4fe3-8951-e806e03d75df", "tag": "f8aab089-e92e-4878-9e65-909bae4b4adf"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:00.447096 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f6d9e86c-2c7a-4049-9441-879381abae28 req-30655c9e-d687-4046-9d9b-dcf574bbadca service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:00.447578 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f6d9e86c-2c7a-4049-9441-879381abae28 req-30655c9e-d687-4046-9d9b-dcf574bbadca service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:00.448014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-f6d9e86c-2c7a-4049-9441-879381abae28 req-30655c9e-d687-4046-9d9b-dcf574bbadca service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:00.462100 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-f6d9e86c-2c7a-4049-9441-879381abae28 req-30655c9e-d687-4046-9d9b-dcf574bbadca service nova] Creating event network-changed:f8aab089-e92e-4878-9e65-909bae4b4adf for instance 4499ffdb-91e6-4fe3-8951-e806e03d75df on hv-cinder-85226 Aug 10 12:41:00.466856 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-f6d9e86c-2c7a-4049-9441-879381abae28 req-30655c9e-d687-4046-9d9b-dcf574bbadca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034253 Aug 10 12:41:00.467448 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 509/1034] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:00.546755 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:00.554657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-790581fe-7c2e-444f-9d48-bd4ec44dfcb8 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1319 microversion: 2.1 time: 0.243645 Aug 10 12:41:00.555222 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 526/1035] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:00 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:01.577428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:01.578117 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:01.584466 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:01.584952 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:01.585424 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:01.586125 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:01.586578 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:01.587002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:01.717619 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:01.725233 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b472fce2-933f-4a9d-a4d8-ea14cbdcd0a7 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1319 microversion: 2.1 time: 0.153018 Aug 10 12:41:01.725827 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 510/1036] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:01 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:02.745814 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:02.746429 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:02.752808 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:02.753324 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:02.753774 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:02.754465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:02.754923 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:02.755352 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:02.882706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:02.890567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c74fa97f-eef1-4bdc-a983-ccdc6128a187 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1319 microversion: 2.1 time: 0.148660 Aug 10 12:41:02.891131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 527/1037] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:02 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:03.911415 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:03.912148 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:03.918964 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:03.920044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:03.920481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:03.921174 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:03.921650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:03.922071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:04.047077 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:04.054339 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-3817099a-f8d6-4695-a761-a826c1dd3067 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1319 microversion: 2.1 time: 0.147141 Aug 10 12:41:04.054895 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 511/1038] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:03 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:05.051144 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-bb27d60d-06fb-4e9f-b8b4-a6a2098e9260 req-18fab379-d0da-427a-8e73-7dbf8a0ff65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4499ffdb-91e6-4fe3-8951-e806e03d75df", "name": "network-vif-plugged", "status": "completed", "tag": "f8aab089-e92e-4878-9e65-909bae4b4adf"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:05.062120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-bb27d60d-06fb-4e9f-b8b4-a6a2098e9260 req-18fab379-d0da-427a-8e73-7dbf8a0ff65c service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:05.062602 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-bb27d60d-06fb-4e9f-b8b4-a6a2098e9260 req-18fab379-d0da-427a-8e73-7dbf8a0ff65c service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:05.063034 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-bb27d60d-06fb-4e9f-b8b4-a6a2098e9260 req-18fab379-d0da-427a-8e73-7dbf8a0ff65c service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:05.074055 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-bb27d60d-06fb-4e9f-b8b4-a6a2098e9260 req-18fab379-d0da-427a-8e73-7dbf8a0ff65c service nova] Creating event network-vif-plugged:f8aab089-e92e-4878-9e65-909bae4b4adf for instance 4499ffdb-91e6-4fe3-8951-e806e03d75df on hv-cinder-85226 Aug 10 12:41:05.074810 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:05.075633 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:05.079029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-bb27d60d-06fb-4e9f-b8b4-a6a2098e9260 req-18fab379-d0da-427a-8e73-7dbf8a0ff65c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031588 Aug 10 12:41:05.079778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 528/1039] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:05.081778 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:05.082269 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:05.082711 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:05.083441 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:05.083903 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:05.084358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:05.219927 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:05.227610 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-de7381ea-01f2-4370-906c-df1c39e45116 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1319 microversion: 2.1 time: 0.156734 Aug 10 12:41:05.228183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 512/1040] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:05 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:06.249961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:06.250657 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:06.256698 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:06.257172 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:06.257630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:06.258312 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:06.258765 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:06.259186 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:06.568243 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:06.575631 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0feb4822-b53d-4b96-895d-4f23f2a1f831 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1319 microversion: 2.1 time: 0.330822 Aug 10 12:41:06.576192 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 529/1041] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:06 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:07.596742 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:07.597376 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:07.603762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:07.604248 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:07.604677 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:07.605407 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:07.605864 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:07.606290 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:07.785091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:07.792492 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7ff80ca5-4eef-4da1-a707-4e2a42fab8e6 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1508 microversion: 2.1 time: 0.199890 Aug 10 12:41:07.793078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 513/1042] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:07 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:07.813223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f9209f5-4fad-4fd6-96f7-ad0af1d0c72c", "device": "/dev/sdb"}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:07.816105 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:07.822381 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:07.822856 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:07.823297 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:07.823981 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:07.824435 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:07.824858 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:08.082416 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-93203db7-ac2b-4140-8788-4da73a4e9d65 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "POST /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273515 Aug 10 12:41:08.083333 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 530/1043] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 10 12:41:07 2022] POST /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:16.551738 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:41:16.552298 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Wed Aug 10 12:41:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:41:20.346533 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:41:20.347185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Wed Aug 10 12:41:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:41:20.864274 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:20.864804 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:20.866678 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:20.867324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=6 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:20.868575 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:20.869210 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:20.876026 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:20.876509 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:20.876946 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:20.877669 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:20.878129 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:20.878556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:20.902545 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.objects.instance [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lazy-loading 'flavor' on Instance uuid 4d0cda6b-0e67-4271-898c-65bd1636dec8 {{(pid=118381) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:41:20.972925 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-41b859ce-1e8b-414e-a086-795e53e4a21d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "POST /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8/action" status: 202 len: 0 microversion: 2.1 time: 0.112420 Aug 10 12:41:20.973530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 514/1044] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:41:20 2022] POST /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:41:20.982133 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:20.982821 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:20.985358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:20.986032 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=22 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:20.986775 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:20.993771 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:20.994201 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:20.994636 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:20.995328 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:20.995780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:20.996202 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:21.125771 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:21.133201 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c5d2cb0d-92f2-4093-94fa-2a2063657919 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.155219 Aug 10 12:41:21.133793 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 531/1045] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:20 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:22.155828 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:22.156556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:22.162632 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:22.163118 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:22.163555 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:22.164245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:22.164700 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:22.165124 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:22.299082 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:22.306505 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7a12fd97-86ee-46f8-98cf-346380a528bf tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.155514 Aug 10 12:41:22.307069 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 515/1046] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:22 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:23.328586 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:23.329127 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:23.335463 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:23.335943 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:23.336379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:23.337064 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:23.337541 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:23.337963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:23.471146 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:23.478642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-661a1306-9ade-4587-8381-f240edcb64a6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.154541 Aug 10 12:41:23.479420 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 532/1047] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:23 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:24.500146 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:24.500870 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:24.508371 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:24.508867 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:24.509330 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:24.510035 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:24.510534 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:24.510965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:24.641236 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:24.649158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-149fd880-503c-4b40-aa33-f48d9f741b6c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.153202 Aug 10 12:41:24.649747 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 516/1048] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:24 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:25.671022 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:25.671663 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:25.678641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:25.679121 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:25.679554 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:25.680242 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:25.680696 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:25.681145 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:25.809680 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:25.817951 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a551e5ef-7032-4aa9-b4cb-93afd907fe7a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.150746 Aug 10 12:41:25.818522 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 533/1049] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:25 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:26.839002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:26.839605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:26.846245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:26.846774 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:26.847154 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:26.847839 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:26.848291 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:26.848712 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:26.975666 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:26.983016 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-610faa5e-34f7-422e-824f-0375756c95f5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.147899 Aug 10 12:41:26.983587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 517/1050] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:26 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:27.408828 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:27.409347 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:27.415630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:27.416118 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:27.416558 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:27.417256 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:27.417768 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:27.418208 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:27.501622 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lazy-loading 'services' on Instance uuid 4499ffdb-91e6-4fe3-8951-e806e03d75df {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:41:27.570782 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c187ddc8-6049-4d72-81de-840469ea5f60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df/os-volume_attachments/6f9209f5-4fad-4fd6-96f7-ad0af1d0c72c" status: 202 len: 0 microversion: 2.1 time: 0.166178 Aug 10 12:41:27.571361 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 534/1051] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 10 12:41:27 2022] DELETE /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df/os-volume_attachments/6f9209f5-4fad-4fd6-96f7-ad0af1d0c72c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:41:28.005003 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:28.005732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:28.012063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:28.012560 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:28.012997 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:28.013717 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:28.014176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:28.014605 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:28.153777 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:28.162101 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c32e6980-8d50-4948-9a1c-67f6f5cd548b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.161328 Aug 10 12:41:28.162683 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 518/1052] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:27 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:28.689456 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:28.690035 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:28.696130 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:28.696620 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:28.697383 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:28.697762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:28.698213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:28.698639 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:28.723645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:41:28.797041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-f57843b5-cd9a-4bdd-9310-8ec52b5b5613 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 204 len: 0 microversion: 2.1 time: 0.111924 Aug 10 12:41:28.797694 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 535/1053] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:41:28 2022] DELETE /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:41:28.807129 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:28.807808 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:28.813984 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:28.814469 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:28.814902 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:28.815598 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:28.816049 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:28.816468 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:28.942684 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:28.950084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-2a2e98af-e396-4180-a74f-83941bc3a1c9 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1514 microversion: 2.1 time: 0.147427 Aug 10 12:41:28.950659 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 519/1054] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:28 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:29.183885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:29.184577 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:29.190505 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:29.190993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:29.191432 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:29.192120 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:29.192575 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:29.193025 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:29.324780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:29.332863 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-b9d5b849-1d95-44b5-a570-616de48faff9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.153232 Aug 10 12:41:29.333457 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 536/1055] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:29 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:29.972712 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:29.973348 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:29.979675 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:29.980161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:29.980593 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:29.981302 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:29.981764 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:29.982190 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:30.110344 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:30.118539 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-fd2f8a2b-6ace-4418-9bc7-5c152ec76573 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1514 microversion: 2.1 time: 0.150043 Aug 10 12:41:30.119106 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 520/1056] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:29 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:30.353302 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:30.353873 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:30.360228 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:30.361341 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:30.361780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:30.362469 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:30.362924 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:30.363357 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:30.489534 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:30.496986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-447c0458-e7d1-4840-acfa-268ac492357c tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.147637 Aug 10 12:41:30.497561 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 537/1057] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:30 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:31.014003 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-cc74b2f7-164e-401d-b45c-90fcd6e46ab2 req-ef55c824-69bb-4db8-99a6-c097220cb7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4499ffdb-91e6-4fe3-8951-e806e03d75df", "name": "network-vif-deleted", "tag": "f8aab089-e92e-4878-9e65-909bae4b4adf"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:31.024749 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cc74b2f7-164e-401d-b45c-90fcd6e46ab2 req-ef55c824-69bb-4db8-99a6-c097220cb7a7 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:31.025231 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cc74b2f7-164e-401d-b45c-90fcd6e46ab2 req-ef55c824-69bb-4db8-99a6-c097220cb7a7 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:31.025697 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-cc74b2f7-164e-401d-b45c-90fcd6e46ab2 req-ef55c824-69bb-4db8-99a6-c097220cb7a7 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:31.036554 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-cc74b2f7-164e-401d-b45c-90fcd6e46ab2 req-ef55c824-69bb-4db8-99a6-c097220cb7a7 service nova] Creating event network-vif-deleted:f8aab089-e92e-4878-9e65-909bae4b4adf for instance 4499ffdb-91e6-4fe3-8951-e806e03d75df on hv-cinder-85226 Aug 10 12:41:31.041900 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-cc74b2f7-164e-401d-b45c-90fcd6e46ab2 req-ef55c824-69bb-4db8-99a6-c097220cb7a7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031823 Aug 10 12:41:31.042533 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 521/1058] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:31.139465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:31.140072 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:31.147540 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:31.148023 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:31.148460 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:31.149624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:31.150233 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:31.150669 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:31.181108 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:31.181523 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:31.181963 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:31.182407 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.objects.instance [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lazy-loading 'fault' on Instance uuid 4499ffdb-91e6-4fe3-8951-e806e03d75df {{(pid=118379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:41:31.223204 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41879b8ab41b49f79ad7f8ae4871f251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f797ec18d0a847748116b1dd18bc8cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:31.230570 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-83b03faa-a9cb-4900-80a8-dab88c77d756 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 200 len: 1309 microversion: 2.1 time: 0.095050 Aug 10 12:41:31.231126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 538/1059] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:31 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:31.518507 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:31.519437 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:31.526475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:31.526965 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:31.527411 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:31.528112 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:31.528574 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:31.529004 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:31.665309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:31.672831 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-18eb23ab-0b71-4d02-a866-8890c51e92d9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.158436 Aug 10 12:41:31.674010 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 522/1060] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:31 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:32.251586 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:32.252199 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] [instance: 4499ffdb-91e6-4fe3-8951-e806e03d75df] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:32.258530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:32.259016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:32.259453 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:32.260144 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:32.260630 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:32.261059 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:32.274802 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] HTTP exception thrown: Instance 4499ffdb-91e6-4fe3-8951-e806e03d75df could not be found. Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Request method failure captured: Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df HTTP/1.1 Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86cV6t8efz-74e8CgsS13MWiw7C4hPoLP90Yk_iI6ghK3f9FGdIBua052KBHN-1MGvp0pqvkM6hzfqsxS0ba_wLjPLUPGNdvpbOTBhUuz-duzmN-KsM9NMOtD6ErDgWO49uc4G1uPGyW3U355QXbuicegVpdpcsjSPA3QbTWxnqM_j4 Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: f797ec18d0a847748116b1dd18bc8cf1 Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1327441136 Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:41:32.276436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f797ec18d0a847748116b1dd18bc8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f797ec18d0a847748116b1dd18bc8cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f797ec18d0a847748116b1dd18bc8cf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f797ec18d0a847748116b1dd18bc8cf1"}]}] Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-VolumesSnapshotTestJSON-1327441136 Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: f797ec18d0a847748116b1dd18bc8cf1 Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1327441136 Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-VolumesSnapshotTestJSON-1327441136-project Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 41879b8ab41b49f79ad7f8ae4871f251 Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-VolumesSnapshotTestJSON-1327441136-project Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 4499ffdb-91e6-4fe3-8951-e806e03d75df could not be found. Aug 10 12:41:32.278113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '4499ffdb-91e6-4fe3-8951-e806e03d75df'} Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4499ffdb-91e6-4fe3-8951-e806e03d75df could not be found. Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:41:32.279198 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4499ffdb-91e6-4fe3-8951-e806e03d75df could not be found. Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4499ffdb-91e6-4fe3-8951-e806e03d75df could not be found. Aug 10 12:41:32.280874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:41:32.282306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] Returning 404 to user: Instance 4499ffdb-91e6-4fe3-8951-e806e03d75df could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:41:32.282306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-76d8a0f8-04e0-4316-89b7-9ca089006a60 tempest-VolumesSnapshotTestJSON-1327441136 tempest-VolumesSnapshotTestJSON-1327441136-project] 10.222.0.65 "GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df" status: 404 len: 111 microversion: 2.1 time: 0.030143 Aug 10 12:41:32.282306 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 539/1061] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:32 2022] GET /compute/v2.1/servers/4499ffdb-91e6-4fe3-8951-e806e03d75df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:41:32.694916 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:32.695521 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:32.701851 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:32.702330 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:32.702758 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:32.703443 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:32.703897 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:32.704852 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:32.833543 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:32.840920 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-adefc78a-359a-4308-853a-595c0aa46eb1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.150100 Aug 10 12:41:32.841523 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 523/1062] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:32 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:33.863422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:33.864045 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:33.870395 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:33.870885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:33.871325 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:33.872021 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:33.872477 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:33.872904 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:34.007057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:34.014550 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-029a1f5b-16b9-468e-94da-a766d9d2d74b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.155691 Aug 10 12:41:34.015114 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 540/1063] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:33 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:35.035640 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:35.036175 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:35.042587 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:35.043065 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:35.043497 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:35.044183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:35.044635 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:35.045054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:35.175377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:35.182814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c72e96af-0f2b-4d7c-abd4-9756812cd097 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.151116 Aug 10 12:41:35.183388 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 524/1064] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:35 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:36.205015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:36.205645 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:36.212127 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:36.212610 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:36.213044 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:36.213762 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:36.214221 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:36.214643 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:36.344160 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:36.351853 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-fd76e214-9b2e-4769-9f36-cf2209ca6e66 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.151339 Aug 10 12:41:36.352410 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 541/1065] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:36 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:36.962872 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:41:36.963352 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Wed Aug 10 12:41:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:41:37.372852 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:37.373413 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:37.379794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:37.380286 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:37.380728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:37.381459 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:37.381922 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:37.382352 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:37.515314 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:37.523921 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-5c3e0c63-68e6-4e50-bfd5-f0f9b7f057e2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.155040 Aug 10 12:41:37.524515 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 525/1066] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:37 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:38.546847 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:38.547530 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:38.554472 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:38.554950 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:38.555408 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:38.556113 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:38.556560 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:38.556980 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:38.691496 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:38.698965 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ffd9fad9-8829-4e5a-9ef1-57cd2af5a2b2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1508 microversion: 2.1 time: 0.156769 Aug 10 12:41:38.699537 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 542/1067] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:38 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:38.720419 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:38.721078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:38.727369 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:38.727845 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:38.728272 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:38.728956 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:38.729437 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:38.729861 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:38.757033 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118381) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 12:41:38.815973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-00f35919-7545-4291-b9aa-0e0cefc76057 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "POST /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8/action" status: 202 len: 0 microversion: 2.1 time: 0.100292 Aug 10 12:41:38.816645 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 526/1068] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 10 12:41:38 2022] POST /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:41:38.825132 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:38.825856 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:38.832269 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:38.832760 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:38.833309 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:38.834020 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:38.834476 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:38.834905 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:38.972788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:38.980493 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-206eb321-3e14-4d4a-a882-3f67313aa7dc tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1516 microversion: 2.1 time: 0.159402 Aug 10 12:41:38.981703 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 543/1069] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:38 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:39.249203 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-fe233cbd-5a38-47af-803c-4a995302ffe2 req-99fc627b-8d15-4e71-9bf9-91293bfdac32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0cda6b-0e67-4271-898c-65bd1636dec8", "name": "network-vif-unplugged", "status": "completed", "tag": "0bcd71a0-e429-40d7-b546-9eb4fc13e34a"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:39.258977 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fe233cbd-5a38-47af-803c-4a995302ffe2 req-99fc627b-8d15-4e71-9bf9-91293bfdac32 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:39.259453 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fe233cbd-5a38-47af-803c-4a995302ffe2 req-99fc627b-8d15-4e71-9bf9-91293bfdac32 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:39.260072 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-fe233cbd-5a38-47af-803c-4a995302ffe2 req-99fc627b-8d15-4e71-9bf9-91293bfdac32 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:39.273176 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.compute.server_external_events [req-fe233cbd-5a38-47af-803c-4a995302ffe2 req-99fc627b-8d15-4e71-9bf9-91293bfdac32 service nova] Unable to find a host for instance 4d0cda6b-0e67-4271-898c-65bd1636dec8. Dropping event network-vif-unplugged {{(pid=118381) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 12:41:39.274088 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-fe233cbd-5a38-47af-803c-4a995302ffe2 req-99fc627b-8d15-4e71-9bf9-91293bfdac32 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028808 Aug 10 12:41:39.275139 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 527/1070] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 12:41:40.001617 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:40.002229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:40.008801 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:40.009315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:40.009759 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:40.010450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:40.010910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:40.011337 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:40.141048 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:40.148516 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-1b496bb9-dad5-4123-af5b-1783528a55c9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1518 microversion: 2.1 time: 0.150817 Aug 10 12:41:40.149097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 544/1071] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:39 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:41.171726 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:41.172340 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:41.179335 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:41.179817 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:41.180254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:41.180970 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:41.181461 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:41.181891 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:41.309358 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:41.312805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:41.318313 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-dc49e830-aa08-4573-97da-5eee0bb6b7a2 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.150467 Aug 10 12:41:41.318879 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 528/1072] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:41 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:42.339918 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:42.340529 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:42.347271 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:42.347751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:42.348183 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:42.348866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:42.349339 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:42.349764 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:42.366956 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:42.482728 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:42.490624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-a104db57-c91e-4b2d-8632-0ed50dbd46c5 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.154515 Aug 10 12:41:42.491190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 545/1073] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:42 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:43.511869 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:43.512476 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:43.520463 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:43.520943 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:43.521407 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:43.522096 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:43.522549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:43.522973 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:43.656660 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:43.664007 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-994703ab-a7a3-4a98-9e06-99e9d27fd2b6 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.156013 Aug 10 12:41:43.664569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 529/1074] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:43 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:44.684162 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:44.684778 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:44.691241 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:44.691729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:44.692173 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:44.692866 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:44.693352 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:44.693786 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:44.822907 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:44.830895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-84ebf2b5-43a2-4fcd-a61b-da88a326b593 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.150602 Aug 10 12:41:44.831487 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 546/1075] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:44 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:45.852097 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:45.852650 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:45.858888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:45.859365 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:45.859796 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:45.861140 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:45.861648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:45.862069 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:45.988362 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:45.996410 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-d9d6f90f-d795-4fa8-a642-d65a2ac6b85a tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.148286 Aug 10 12:41:45.996995 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 530/1076] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:45 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:47.017070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:47.017718 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:47.024099 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:47.024585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:47.025029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:47.025745 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:47.026202 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:47.026628 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:47.158061 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:47.165459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-84b4eabf-2186-4e02-8fb2-01f3610973fe tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.152213 Aug 10 12:41:47.166019 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 547/1077] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:47 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:48.186975 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:48.187577 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:48.193850 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:48.194330 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:48.194762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:48.195447 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:48.195898 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:48.196316 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:48.323762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:48.331251 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7414cf10-2d59-40d8-99dc-e50b073a8a1f tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.148284 Aug 10 12:41:48.331805 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 531/1078] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:48 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:49.353037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:49.353833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:49.361191 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:49.362364 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:49.362932 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:49.363729 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:49.364254 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:49.364754 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:49.495640 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:49.503658 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-6d6c10f4-3c3f-4302-a40e-d61a7946f262 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.155090 Aug 10 12:41:49.504215 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 548/1079] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:49 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:50.524632 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:50.525237 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:50.531615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:50.532094 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:50.532524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:50.533206 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:50.533681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:50.534102 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:50.663174 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:50.670489 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-70c6a35d-2cd1-45ea-a70d-8fbe7403eac0 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.149693 Aug 10 12:41:50.671041 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 532/1080] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:50 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:51.692995 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:51.693633 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:51.695939 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:51.701251 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:51.701771 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:51.702209 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:51.702899 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:51.703354 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:51.703777 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:51.833051 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:51.840474 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d6207bdc-497e-4df9-933d-88500c4422c3 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.152091 Aug 10 12:41:51.841031 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 549/1081] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:51 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:52.862245 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:52.862876 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:52.865243 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:52.870775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:52.871256 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:52.871683 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:52.872364 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:52.872814 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:52.873234 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:53.004578 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:53.012238 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-0aeca02b-2e99-44ea-aef2-91498c45bc6d tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.153911 Aug 10 12:41:53.012815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 533/1082] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:52 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:54.033299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:54.033917 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:54.040370 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:54.040857 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:54.041315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:54.042004 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:54.042461 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:54.042885 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:54.175247 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:54.182650 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e92b0eb3-d665-4a6d-ac20-81a4aa0cc5d7 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.153319 Aug 10 12:41:54.183213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 550/1083] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:54 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:55.204044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:55.204688 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:55.211843 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:55.212326 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:55.212760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:55.213500 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:55.214149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:55.214655 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:55.276792 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-f7466992-3e26-4caf-aa91-4a08bc8920fa req-b1aadf48-56a0-461a-b6aa-7a57e8cd8929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0cda6b-0e67-4271-898c-65bd1636dec8", "name": "network-vif-plugged", "status": "completed", "tag": "0bcd71a0-e429-40d7-b546-9eb4fc13e34a"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:55.289785 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-f7466992-3e26-4caf-aa91-4a08bc8920fa req-b1aadf48-56a0-461a-b6aa-7a57e8cd8929 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:55.290857 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-f7466992-3e26-4caf-aa91-4a08bc8920fa req-b1aadf48-56a0-461a-b6aa-7a57e8cd8929 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:55.293500 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-f7466992-3e26-4caf-aa91-4a08bc8920fa req-b1aadf48-56a0-461a-b6aa-7a57e8cd8929 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:55.305620 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-f7466992-3e26-4caf-aa91-4a08bc8920fa req-b1aadf48-56a0-461a-b6aa-7a57e8cd8929 service nova] Creating event network-vif-plugged:0bcd71a0-e429-40d7-b546-9eb4fc13e34a for instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 on hv-cinder-85226 Aug 10 12:41:55.311425 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-f7466992-3e26-4caf-aa91-4a08bc8920fa req-b1aadf48-56a0-461a-b6aa-7a57e8cd8929 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038648 Aug 10 12:41:55.313194 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 551/1084] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:55.361998 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:55.369906 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-bcf84afa-985f-4546-b472-29466360d048 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.169667 Aug 10 12:41:55.370443 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 534/1085] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:55 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:56.071358 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-225632072", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1160807107", "security_groups": [{"name": "tempest-secgroup-smoke-1740254587"}], "block_device_mapping_v2": [{"uuid": "3ce14ea1-6664-4204-a112-45a0394427be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ce24948c-b056-4a3f-868d-8498edb8d6bb"}]}} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:56.180387 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.network.neutron [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] validate_networks() for [('ce24948c-b056-4a3f-868d-8498edb8d6bb', None, None, None, None, None)] {{(pid=118379) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:41:56.392279 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:56.392910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:56.400216 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:56.400728 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:56.401163 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:56.402254 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:56.402720 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:56.403158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:56.543031 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:56.550648 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-4ccf31d2-ff4e-4d00-89a9-d89736be04e1 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1574 microversion: 2.1 time: 0.162997 Aug 10 12:41:56.551312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 535/1086] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:56 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:56.593486 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Flavor limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:41:56.593924 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Image limits 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:41:56.594411 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Flavor pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:41:56.594829 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Image pref 0:0:0 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:41:56.595509 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.virt.hardware [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:41:56.604471 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:56.605606 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:56.606057 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:56.606796 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:56.607342 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:56.607836 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:56.624339 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Getting quotas for project f63c30b5d2af4144b096b78c7ab308a7. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:56.629432 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.quota [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Getting quotas for user 770127af5f494b7e9198438441868fa1 and project f63c30b5d2af4144b096b78c7ab308a7. Resources: {'cores', 'instances', 'ram'} {{(pid=118379) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:56.692360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Going to run 1 instances... {{(pid=118379) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:41:56.695467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ce14ea1-6664-4204-a112-45a0394427be',volume_size=None,volume_type=None)] {{(pid=118379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:41:56.824277 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-dec9f03d-744e-4646-ab2f-a390d18b40f6 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.757595 Aug 10 12:41:56.824929 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 552/1087] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 10 12:41:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:41:56.835775 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-6a55af35-75d8-4718-ad62-313e06e5c17c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:56.836387 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-6a55af35-75d8-4718-ad62-313e06e5c17c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:56.891225 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-6a55af35-75d8-4718-ad62-313e06e5c17c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:56.898311 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-6a55af35-75d8-4718-ad62-313e06e5c17c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1094 microversion: 2.1 time: 0.066352 Aug 10 12:41:56.898910 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 536/1088] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:56 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:57.572015 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:57.576877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:57.581584 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:57.582213 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:57.582753 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:57.583512 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:57.584134 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:57.584450 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:57.713898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:57.722252 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-d768e672-76b2-41b4-824f-a9d611f32e9e tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1561 microversion: 2.1 time: 0.154038 Aug 10 12:41:57.722966 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 553/1089] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:57 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:57.918549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:57.919183 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:57.928368 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:57.928866 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:57.929332 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:57.930038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:57.930506 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:57.930939 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:57.995681 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:58.004309 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7b688f47-094a-40d1-b158-9a34fb729748 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1210 microversion: 2.1 time: 0.089313 Aug 10 12:41:58.014186 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 537/1090] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:57 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:59.024852 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:59.025481 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:59.032093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.032780 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.033421 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.034389 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.034843 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.035433 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.244716 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:59.255139 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-ce15db26-87fa-4141-977c-64d8f7d389dd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.233902 Aug 10 12:41:59.275993 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 554/1091] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:59 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:59.354938 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-49173f60-c967-4389-90f9-4c809041d13b req-5d27e195-3e17-4842-a9d6-018c96e221a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55", "tag": "ca68d324-d731-4522-8d94-446746fae058"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:59.365961 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-49173f60-c967-4389-90f9-4c809041d13b req-5d27e195-3e17-4842-a9d6-018c96e221a7 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.366432 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-49173f60-c967-4389-90f9-4c809041d13b req-5d27e195-3e17-4842-a9d6-018c96e221a7 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.366868 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-49173f60-c967-4389-90f9-4c809041d13b req-5d27e195-3e17-4842-a9d6-018c96e221a7 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.377877 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-49173f60-c967-4389-90f9-4c809041d13b req-5d27e195-3e17-4842-a9d6-018c96e221a7 service nova] Creating event network-changed:ca68d324-d731-4522-8d94-446746fae058 for instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 on hv-cinder-85226 Aug 10 12:41:59.383894 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-49173f60-c967-4389-90f9-4c809041d13b req-5d27e195-3e17-4842-a9d6-018c96e221a7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126214 Aug 10 12:41:59.384490 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 538/1092] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:00.275897 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:00.276751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:00.283711 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:00.284325 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:00.284858 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:00.285685 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:00.286327 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:00.286903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:00.502421 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:00.511515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e9de9cb9-9cb1-4ad7-adfa-b731e5a0a48a tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.239445 Aug 10 12:42:00.512166 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 555/1093] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:00 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:01.537569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:01.538175 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:01.544242 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:01.544724 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:01.545149 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.545854 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:01.546307 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:01.546730 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.675483 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:01.683063 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-e0377cad-19b3-4f52-abdb-ecadab7cf1d8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.150269 Aug 10 12:42:01.683623 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 539/1094] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:01 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:02.703895 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:02.704535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:02.710983 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.711466 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.711900 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.712584 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.713033 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.713506 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.845825 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:02.853131 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-da968e3f-a1e0-4ed8-a4a9-9b77df348137 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.153133 Aug 10 12:42:02.853740 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 556/1095] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:02 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:03.874002 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:03.874537 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:03.881093 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.881621 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.882064 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.882760 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.883224 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.883656 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.014475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:04.021846 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-b0771b35-b3da-4fb9-94e5-5027382368c1 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.151814 Aug 10 12:42:04.022409 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 540/1096] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:03 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:05.042429 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:05.043037 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:05.049436 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.049920 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.050356 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.051095 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.051555 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.051979 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.179085 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:05.186453 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-263457c3-45ba-41d0-844c-af86a4d68d18 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.147848 Aug 10 12:42:05.186991 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 557/1097] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:05 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:06.206281 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:06.206893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:06.213292 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:06.213799 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:06.214238 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:06.214930 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:06.215391 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:06.215815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:06.352208 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:06.359654 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-479a5134-ba96-4d9e-9508-a3970e595d6c tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.157172 Aug 10 12:42:06.360260 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 541/1098] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:06 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:07.382097 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:07.382640 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:07.385066 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=2 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:07.385741 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell0:SELECT=6 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:07.391809 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.392291 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.392724 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.393439 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.393890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.394317 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.529255 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:07.537326 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3ef26065-5ddd-4c9d-be06-6ca93eee54bb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.160153 Aug 10 12:42:07.537893 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 558/1099] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:07 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:08.557440 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:08.558044 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:08.560012 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell0:SELECT=2 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:08.566060 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:08.567119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:08.567561 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:08.568257 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:08.568721 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:08.569147 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:08.709115 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:08.716429 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ba5d4ec1-6b4a-4c5b-8c7c-cd0872c35973 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.162817 Aug 10 12:42:08.716988 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 542/1100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:08 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:09.737041 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:09.737683 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:09.744135 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.744715 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.745195 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.745890 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.746343 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.746767 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.875622 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:09.883545 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-7ad423b3-b49a-4926-8bc3-8620dd6779b2 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.150336 Aug 10 12:42:09.884119 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 559/1101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:09 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:10.903896 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:10.904501 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:10.911538 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:10.912018 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:10.912450 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:10.913136 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:10.913615 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:10.914040 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.045687 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:11.053294 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7af77ba9-9f50-4765-977a-338f1e6afcc8 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.153168 Aug 10 12:42:11.053866 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 543/1102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:10 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:11.578217 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-496de5da-2cd6-42d8-8ef1-8f0eb3076b28 req-9f25064c-b0b9-4534-a906-022012ceb3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55", "name": "network-vif-plugged", "status": "completed", "tag": "ca68d324-d731-4522-8d94-446746fae058"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:11.588300 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-496de5da-2cd6-42d8-8ef1-8f0eb3076b28 req-9f25064c-b0b9-4534-a906-022012ceb3cc service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:11.588770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-496de5da-2cd6-42d8-8ef1-8f0eb3076b28 req-9f25064c-b0b9-4534-a906-022012ceb3cc service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:11.589199 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-496de5da-2cd6-42d8-8ef1-8f0eb3076b28 req-9f25064c-b0b9-4534-a906-022012ceb3cc service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.600088 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-496de5da-2cd6-42d8-8ef1-8f0eb3076b28 req-9f25064c-b0b9-4534-a906-022012ceb3cc service nova] Creating event network-vif-plugged:ca68d324-d731-4522-8d94-446746fae058 for instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 on hv-cinder-85226 Aug 10 12:42:11.605143 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-496de5da-2cd6-42d8-8ef1-8f0eb3076b28 req-9f25064c-b0b9-4534-a906-022012ceb3cc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210631 Aug 10 12:42:11.605982 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 560/1103] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:42:12.073588 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:12.074200 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:12.080433 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.080919 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.081391 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.082090 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.082551 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.082982 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.433883 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:12.441139 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c85c75d1-c69a-463d-a3ed-c7d3fca8c901 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1266 microversion: 2.1 time: 0.371432 Aug 10 12:42:12.441828 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 544/1104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:12 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:13.461898 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:13.462585 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:13.469154 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.469710 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.470403 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.471093 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.471544 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.471965 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.475058 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=81 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:13.604642 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:13.612162 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-c9d14e72-89b8-47fa-9fc0-3ac4df888db3 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1454 microversion: 2.1 time: 0.154478 Aug 10 12:42:13.612726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 561/1105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:13 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:13.632096 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:13.632759 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:13.639071 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.639556 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.639994 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.640689 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.641146 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.641637 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.644138 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=87 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:13.769396 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:13.776840 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-38d7f976-6c8f-47f0-84fb-da39be706968 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1454 microversion: 2.1 time: 0.148591 Aug 10 12:42:13.777428 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 545/1106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:13 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:15.384459 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-c382403c-d0e5-43c1-9be0-20dbf8fa0165 req-eb29fd2e-0a55-44d5-bdae-461e54bff320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55", "tag": "ca68d324-d731-4522-8d94-446746fae058"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:15.394196 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-c382403c-d0e5-43c1-9be0-20dbf8fa0165 req-eb29fd2e-0a55-44d5-bdae-461e54bff320 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.395163 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-c382403c-d0e5-43c1-9be0-20dbf8fa0165 req-eb29fd2e-0a55-44d5-bdae-461e54bff320 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.395590 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-c382403c-d0e5-43c1-9be0-20dbf8fa0165 req-eb29fd2e-0a55-44d5-bdae-461e54bff320 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.407402 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-c382403c-d0e5-43c1-9be0-20dbf8fa0165 req-eb29fd2e-0a55-44d5-bdae-461e54bff320 service nova] Creating event network-changed:ca68d324-d731-4522-8d94-446746fae058 for instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 on hv-cinder-85226 Aug 10 12:42:15.413345 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-c382403c-d0e5-43c1-9be0-20dbf8fa0165 req-eb29fd2e-0a55-44d5-bdae-461e54bff320 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089850 Aug 10 12:42:15.413954 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 562/1107] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:12.854980 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:12.855523 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:12.857514 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=27 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:12.858349 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=5 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:12.864393 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-be941af6-a5b3-415b-bc77-df7bf7621fe2 req-2157b317-158a-442a-ac75-d54545bb666d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d0cda6b-0e67-4271-898c-65bd1636dec8", "tag": "0bcd71a0-e429-40d7-b546-9eb4fc13e34a"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:12.875068 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:12.875569 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:12.876006 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:12.876708 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:12.877165 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:12.877617 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:12.880008 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:12.880857 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=7 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:12.888599 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-be941af6-a5b3-415b-bc77-df7bf7621fe2 req-2157b317-158a-442a-ac75-d54545bb666d service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:12.889011 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-be941af6-a5b3-415b-bc77-df7bf7621fe2 req-2157b317-158a-442a-ac75-d54545bb666d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:12.889479 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-be941af6-a5b3-415b-bc77-df7bf7621fe2 req-2157b317-158a-442a-ac75-d54545bb666d service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:12.908254 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-be941af6-a5b3-415b-bc77-df7bf7621fe2 req-2157b317-158a-442a-ac75-d54545bb666d service nova] Creating event network-changed:0bcd71a0-e429-40d7-b546-9eb4fc13e34a for instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 on hv-cinder-85226 Aug 10 12:43:12.914739 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-be941af6-a5b3-415b-bc77-df7bf7621fe2 req-2157b317-158a-442a-ac75-d54545bb666d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053520 Aug 10 12:43:12.915549 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 563/1108] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:12.919038 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Going to try to terminate instance {{(pid=118381) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:43:13.006144 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-c2ba83b3-d20f-4b10-a8fd-83f82b4713cd tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 204 len: 0 microversion: 2.1 time: 0.154963 Aug 10 12:43:13.009315 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 546/1109] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:43:12 2022] DELETE /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:43:13.016705 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:13.017615 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:13.024726 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:13.026244 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:13.026739 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:13.027567 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:13.028029 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:13.028465 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:13.160379 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:13.168229 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-54f49fb2-82d6-4826-aa54-42ebf7a869ce tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.155723 Aug 10 12:43:13.168902 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 564/1110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:13 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:14.190701 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:14.191394 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:14.198249 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:14.198732 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:14.199162 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:14.199848 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:14.200301 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:14.200727 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:14.335112 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:14.343360 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-946242e9-0ef7-4370-bb1a-6c934043fd53 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1567 microversion: 2.1 time: 0.156903 Aug 10 12:43:14.343923 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 547/1111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:14 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:15.350616 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-9b1e8592-f773-4252-a6ec-ae2a60e7efc6 req-fd6fafb7-ef8c-4aa7-b6cd-298b2245d80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d0cda6b-0e67-4271-898c-65bd1636dec8", "name": "network-vif-deleted", "tag": "0bcd71a0-e429-40d7-b546-9eb4fc13e34a"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:15.362231 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-9b1e8592-f773-4252-a6ec-ae2a60e7efc6 req-fd6fafb7-ef8c-4aa7-b6cd-298b2245d80c service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:15.362748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-9b1e8592-f773-4252-a6ec-ae2a60e7efc6 req-fd6fafb7-ef8c-4aa7-b6cd-298b2245d80c service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:15.363181 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-9b1e8592-f773-4252-a6ec-ae2a60e7efc6 req-fd6fafb7-ef8c-4aa7-b6cd-298b2245d80c service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:15.363841 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:15.365367 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:15.373014 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:15.373541 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:15.373977 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:15.374821 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:15.375295 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:15.375841 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:15.376620 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-9b1e8592-f773-4252-a6ec-ae2a60e7efc6 req-fd6fafb7-ef8c-4aa7-b6cd-298b2245d80c service nova] Creating event network-vif-deleted:0bcd71a0-e429-40d7-b546-9eb4fc13e34a for instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 on hv-cinder-85226 Aug 10 12:43:15.381877 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-9b1e8592-f773-4252-a6ec-ae2a60e7efc6 req-fd6fafb7-ef8c-4aa7-b6cd-298b2245d80c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035027 Aug 10 12:43:15.382743 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 565/1112] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:15.443639 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94df22112d134130a678f91cae49adef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ece09339af406b98e493fa33f2b9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:15.451161 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-aeccbe4e-c54e-42f3-b6ec-3c74e5df5983 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 200 len: 1218 microversion: 2.1 time: 0.091125 Aug 10 12:43:15.451718 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 548/1113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:15 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:16.473519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:16.474223 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] [instance: 4d0cda6b-0e67-4271-898c-65bd1636dec8] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:16.480827 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:16.481340 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:16.481788 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:16.482483 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:16.482948 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:16.483378 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:16.497023 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] HTTP exception thrown: Instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 could not be found. Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Request method failure captured: Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 HTTP/1.1 Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86a3AbWHbyOS4vIT60J0EXdKHBmZzwBwPPKHRhCzbulkfOpahKsJa7fXXJ5XXdVV-csENEzg9FN9U4KOly4SFf0XrLnlkUaJGvKt_oLY8-FWk2gXbXn3AuWZqVR_VnuCSpIXREpHyHAPZ-jpdh7Fp6ZntgG3awC3C3waUtaGW0yHzmA Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: 65ece09339af406b98e493fa33f2b9c0 Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-TestShelveInstance-1894428611 Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:43:16.498641 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/65ece09339af406b98e493fa33f2b9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_65ece09339af406b98e493fa33f2b9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/65ece09339af406b98e493fa33f2b9c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/65ece09339af406b98e493fa33f2b9c0"}]}] Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-TestShelveInstance-1894428611 Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: 65ece09339af406b98e493fa33f2b9c0 Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-TestShelveInstance-1894428611 Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-TestShelveInstance-1894428611-project Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 94df22112d134130a678f91cae49adef Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-TestShelveInstance-1894428611-project Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 could not be found. Aug 10 12:43:16.500367 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '4d0cda6b-0e67-4271-898c-65bd1636dec8'} Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 could not be found. Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:43:16.501498 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 could not be found. Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 could not be found. Aug 10 12:43:16.503279 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:16.504770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Returning 404 to user: Instance 4d0cda6b-0e67-4271-898c-65bd1636dec8 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:43:16.504770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-960ded89-5fb7-464e-ae35-0bfee74aa2e9 tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8" status: 404 len: 111 microversion: 2.1 time: 0.031558 Aug 10 12:43:16.504770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 566/1114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:16 2022] GET /compute/v2.1/servers/4d0cda6b-0e67-4271-898c-65bd1636dec8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:43:16.664716 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-23852adc-1254-4bd0-9fa3-81e9a4e84d3b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] Calling method '.version_select at 0x7fcb981075e0>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:16.688401 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-23852adc-1254-4bd0-9fa3-81e9a4e84d3b tempest-TestShelveInstance-1894428611 tempest-TestShelveInstance-1894428611-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-873003824" status: 202 len: 0 microversion: 2.1 time: 0.027480 Aug 10 12:43:16.689455 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 549/1115] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 10 12:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-873003824 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:43:45.480078 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:45.480673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:45.480673 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:45.481168 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG dbcounter [-] [118381] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:45.482874 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_api:SELECT=8 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:45.483513 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG dbcounter [-] [118379] Writing DB stats nova_cell1:SELECT=12 {{(pid=118379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:45.484862 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-91c5ecad-3633-4edc-a6f5-24965cf5dba6 req-de8cc5d0-c36e-4529-9659-f39eb74672b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55", "tag": "ca68d324-d731-4522-8d94-446746fae058"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:45.488986 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.489522 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.489961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.490663 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.491117 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.491538 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.503481 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-91c5ecad-3633-4edc-a6f5-24965cf5dba6 req-de8cc5d0-c36e-4529-9659-f39eb74672b9 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.503970 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-91c5ecad-3633-4edc-a6f5-24965cf5dba6 req-de8cc5d0-c36e-4529-9659-f39eb74672b9 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.504403 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-91c5ecad-3633-4edc-a6f5-24965cf5dba6 req-de8cc5d0-c36e-4529-9659-f39eb74672b9 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.517880 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:43:45.518119 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-91c5ecad-3633-4edc-a6f5-24965cf5dba6 req-de8cc5d0-c36e-4529-9659-f39eb74672b9 service nova] Creating event network-changed:ca68d324-d731-4522-8d94-446746fae058 for instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 on hv-cinder-85226 Aug 10 12:43:45.523383 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-91c5ecad-3633-4edc-a6f5-24965cf5dba6 req-de8cc5d0-c36e-4529-9659-f39eb74672b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044593 Aug 10 12:43:45.524170 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 550/1116] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:43:45.615094 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-e461323a-fbc6-43eb-85c1-9a18660ea675 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 204 len: 0 microversion: 2.1 time: 0.137445 Aug 10 12:43:45.615864 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 567/1117] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:43:45 2022] DELETE /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:43:45.626224 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:45.627158 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:45.633330 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.633816 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.634276 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.635409 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.635893 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.636316 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.770824 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:45.778473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-1a84b8fb-af4b-461b-9471-75eebb06cca9 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1578 microversion: 2.1 time: 0.157538 Aug 10 12:43:45.779027 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 551/1118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:45 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:46.804246 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:46.805039 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:46.810907 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.811389 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.811823 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.812512 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.812965 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.813412 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.978360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:46.986515 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-03713f76-4132-4eeb-b46e-5384cf505c64 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1578 microversion: 2.1 time: 0.188696 Aug 10 12:43:46.987079 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 568/1119] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:46 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:48.007031 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:48.007672 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:48.014123 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.014613 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.015047 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.015736 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.016191 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.016610 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.085091 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:48.094549 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-01bf147f-f662-4a7b-b3a8-b2b57555e5a4 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 200 len: 1392 microversion: 2.1 time: 0.091333 Aug 10 12:43:48.095132 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 552/1120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:48 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 1392 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:48.124185 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [req-a486b296-3043-4f63-92d8-84d01363a5b6 req-862a0e65-9001-4fa6-bdee-38da729ab9eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55", "name": "network-vif-deleted", "tag": "ca68d324-d731-4522-8d94-446746fae058"}]} {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:48.136070 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-a486b296-3043-4f63-92d8-84d01363a5b6 req-862a0e65-9001-4fa6-bdee-38da729ab9eb service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.136770 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-a486b296-3043-4f63-92d8-84d01363a5b6 req-862a0e65-9001-4fa6-bdee-38da729ab9eb service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.137566 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [req-a486b296-3043-4f63-92d8-84d01363a5b6 req-862a0e65-9001-4fa6-bdee-38da729ab9eb service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.151903 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.compute.server_external_events [req-a486b296-3043-4f63-92d8-84d01363a5b6 req-862a0e65-9001-4fa6-bdee-38da729ab9eb service nova] Creating event network-vif-deleted:ca68d324-d731-4522-8d94-446746fae058 for instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 on hv-cinder-85226 Aug 10 12:43:48.157629 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [req-a486b296-3043-4f63-92d8-84d01363a5b6 req-862a0e65-9001-4fa6-bdee-38da729ab9eb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037707 Aug 10 12:43:48.158422 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 569/1121] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:49.115981 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:49.116530 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:49.123399 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:49.123885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:49.124324 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:49.125013 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:49.125499 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:49.125926 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:49.139786 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] HTTP exception thrown: Instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 could not be found. Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Request method failure captured: Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 HTTP/1.1 Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86ZVo2naWqRa6EgkaO0N3U0jGxscmrM8SE6xCQ7zJ91Z_j4Wo7X_lIDHTXj7cEynX5g0vyRBMSIUVvxyusFnlYsMLvR2zURJsFNuFZ-Y4FcM9KB4i-DCGyWDsJE5SxsgYlcldCchISsTEYwI87txMJboQUY64fqoDrG25NaxpG4-U0A Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:43:49.141524 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}] Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 770127af5f494b7e9198438441868fa1 Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 could not be found. Aug 10 12:43:49.143036 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': 'e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55'} Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 could not be found. Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:43:49.144475 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 could not be found. Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 could not be found. Aug 10 12:43:49.146182 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.147686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Returning 404 to user: Instance e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:43:49.147686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-f348342b-4304-4204-b898-6e87cb4063fe tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55" status: 404 len: 111 microversion: 2.1 time: 0.030907 Aug 10 12:43:49.147686 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 553/1122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:49 2022] GET /compute/v2.1/servers/e3a7273c-2b4c-4f02-99a4-a61f3cfdaa55 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:43:52.180643 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:52.181384 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:52.182037 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-4a481974-95be-4b43-9c52-7951e1b4df70 req-29f82860-fe1f-4737-8054-c8572afdc82f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c86ad14-7c49-41a0-b663-eea08e579aa6", "tag": "850b26e9-2603-4ccd-84ec-00ede7dfd424"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:52.188360 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:52.189089 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:52.189731 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.190623 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:52.191377 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:52.191864 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4a481974-95be-4b43-9c52-7951e1b4df70 req-29f82860-fe1f-4737-8054-c8572afdc82f service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:52.192008 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.192343 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4a481974-95be-4b43-9c52-7951e1b4df70 req-29f82860-fe1f-4737-8054-c8572afdc82f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:52.192766 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-4a481974-95be-4b43-9c52-7951e1b4df70 req-29f82860-fe1f-4737-8054-c8572afdc82f service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.203985 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-4a481974-95be-4b43-9c52-7951e1b4df70 req-29f82860-fe1f-4737-8054-c8572afdc82f service nova] Creating event network-changed:850b26e9-2603-4ccd-84ec-00ede7dfd424 for instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 on hv-cinder-85226 Aug 10 12:43:52.208948 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-4a481974-95be-4b43-9c52-7951e1b4df70 req-29f82860-fe1f-4737-8054-c8572afdc82f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030614 Aug 10 12:43:52.209558 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 554/1123] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:52.218785 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Going to try to terminate instance {{(pid=118379) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:43:52.298613 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-53b452c6-453e-49ee-89b7-ddcb816414a7 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 204 len: 0 microversion: 2.1 time: 0.122177 Aug 10 12:43:52.299305 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 570/1124] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:43:52 2022] DELETE /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:43:52.308457 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:52.309418 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:52.315974 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:52.316464 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:52.317153 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.317888 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:52.318344 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:52.318794 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.456353 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.policy [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118381) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:52.464133 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-7c49e781-3313-4f42-a757-1f4d0cc536cb tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1578 microversion: 2.1 time: 0.160120 Aug 10 12:43:52.464776 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 555/1125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:52 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:53.486129 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:53.486914 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:53.493706 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:53.494190 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:53.494624 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:53.496016 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:53.496478 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:53.496910 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:53.635716 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:53.643769 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-3fda7216-5823-4acb-b651-900376b8f79d tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1578 microversion: 2.1 time: 0.161842 Aug 10 12:43:53.644330 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 571/1126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:53 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:54.528789 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [req-b88a1c09-76ee-452a-b155-ed4c1a0b1462 req-39e3107f-3532-4c06-85bb-268edb771fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c86ad14-7c49-41a0-b663-eea08e579aa6", "name": "network-vif-deleted", "tag": "850b26e9-2603-4ccd-84ec-00ede7dfd424"}]} {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:54.538410 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-b88a1c09-76ee-452a-b155-ed4c1a0b1462 req-39e3107f-3532-4c06-85bb-268edb771fb8 service nova] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.538885 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-b88a1c09-76ee-452a-b155-ed4c1a0b1462 req-39e3107f-3532-4c06-85bb-268edb771fb8 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.539312 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [req-b88a1c09-76ee-452a-b155-ed4c1a0b1462 req-39e3107f-3532-4c06-85bb-268edb771fb8 service nova] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:54.550030 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.compute.server_external_events [req-b88a1c09-76ee-452a-b155-ed4c1a0b1462 req-39e3107f-3532-4c06-85bb-268edb771fb8 service nova] Creating event network-vif-deleted:850b26e9-2603-4ccd-84ec-00ede7dfd424 for instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 on hv-cinder-85226 Aug 10 12:43:54.554936 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [req-b88a1c09-76ee-452a-b155-ed4c1a0b1462 req-39e3107f-3532-4c06-85bb-268edb771fb8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030318 Aug 10 12:43:54.555570 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 556/1127] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:54.665500 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:54.666105 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:54.672467 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.672944 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.673406 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:54.674092 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.674541 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.674961 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:54.735439 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.policy [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '770127af5f494b7e9198438441868fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63c30b5d2af4144b096b78c7ab308a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118379) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:54.743028 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-0bb51f9f-54f5-485a-8696-41e9cd6770fd tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 200 len: 1226 microversion: 2.1 time: 0.081546 Aug 10 12:43:54.743535 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 572/1128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:54 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:55.763762 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:55.764456 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 9c86ad14-7c49-41a0-b663-eea08e579aa6] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:55.770580 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:55.771054 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:55.771485 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:55.772165 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:55.772616 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:55.773039 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:55.786473 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] HTTP exception thrown: Instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 could not be found. Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Request method failure captured: Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 HTTP/1.1 Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86ZVo2naWqRa6EgkaO0N3U0jGxscmrM8SE6xCQ7zJ91Z_j4Wo7X_lIDHTXj7cEynX5g0vyRBMSIUVvxyusFnlYsMLvR2zURJsFNuFZ-Y4FcM9KB4i-DCGyWDsJE5SxsgYlcldCchISsTEYwI87txMJboQUY64fqoDrG25NaxpG4-U0A Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:43:55.788089 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}] Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 770127af5f494b7e9198438441868fa1 Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 could not be found. Aug 10 12:43:55.789815 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '9c86ad14-7c49-41a0-b663-eea08e579aa6'} Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 could not be found. Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:43:55.790702 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 could not be found. Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 could not be found. Aug 10 12:43:55.792052 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:55.793887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Returning 404 to user: Instance 9c86ad14-7c49-41a0-b663-eea08e579aa6 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:43:55.793887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-ae37613c-6148-4991-a0cf-dbf4ae4bfe6e tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6" status: 404 len: 111 microversion: 2.1 time: 0.030520 Aug 10 12:43:55.793887 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 557/1129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:55 2022] GET /compute/v2.1/servers/9c86ad14-7c49-41a0-b663-eea08e579aa6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:43:56.214999 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:56.215501 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.compute.api [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118379) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:56.222262 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.222748 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.223191 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.223879 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.224338 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.224766 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG oslo_concurrency.lockutils [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.237495 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.wsgi [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] HTTP exception thrown: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Request method failure captured: Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: request: DELETE /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 HTTP/1.1 Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept: application/json Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Accept-Encoding: identity Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Connection: close Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Length: 0 Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Content-Type: application/json Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Host: 10.222.0.65 Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Openstack-System-Scope: None Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: User-Agent: python-urllib3/1.26.11 Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Auth-Token: gAAAAABi86ZVo2naWqRa6EgkaO0N3U0jGxscmrM8SE6xCQ7zJ91Z_j4Wo7X_lIDHTXj7cEynX5g0vyRBMSIUVvxyusFnlYsMLvR2zURJsFNuFZ-Y4FcM9KB4i-DCGyWDsJE5SxsgYlcldCchISsTEYwI87txMJboQUY64fqoDrG25NaxpG4-U0A Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Id: None Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Domain-Name: None Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Identity-Status: Confirmed Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Is-Admin-Project: True Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Id: default Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Domain-Name: Default Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Project-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Role: member,reader Aug 10 12:43:56.239126 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Roles: member,reader Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}] Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-Tenant-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Id: default Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Domain-Name: Default Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Id: 770127af5f494b7e9198438441868fa1 Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: X-User-Name: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: method: > Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: exception: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.240772 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: action_args: {'id': '461c4836-f025-459c-9295-0a840e0e2066'} Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:43:56.241751 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.243299 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.244850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Returning 404 to user: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. {{(pid=118379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:43:56.244850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-4217b324-0931-43d7-aad4-0c20f67a5bd5 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "DELETE /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 404 len: 111 microversion: 2.1 time: 0.030026 Aug 10 12:43:56.244850 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 573/1130] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 10 12:43:56 2022] DELETE /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 12:43:56.249084 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '>' {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:56.249724 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.compute.api [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] [instance: 461c4836-f025-459c-9295-0a840e0e2066] Fetching instance by UUID {{(pid=118381) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:56.255858 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.256327 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.256771 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.257491 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Acquiring lock "4613c154-23c5-442d-a568-3055672c6934" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.257949 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.258377 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG oslo_concurrency.lockutils [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Lock "4613c154-23c5-442d-a568-3055672c6934" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.272135 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.wsgi [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] HTTP exception thrown: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Request method failure captured: Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: request: GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 HTTP/1.1 Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept: application/json Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Accept-Encoding: identity Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Connection: close Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Length: 0 Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Content-Type: application/json Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Host: 10.222.0.65 Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Openstack-System-Scope: None Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: User-Agent: python-urllib3/1.26.11 Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Auth-Token: gAAAAABi86ZVo2naWqRa6EgkaO0N3U0jGxscmrM8SE6xCQ7zJ91Z_j4Wo7X_lIDHTXj7cEynX5g0vyRBMSIUVvxyusFnlYsMLvR2zURJsFNuFZ-Y4FcM9KB4i-DCGyWDsJE5SxsgYlcldCchISsTEYwI87txMJboQUY64fqoDrG25NaxpG4-U0A Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Id: None Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Domain-Name: None Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Identity-Status: Confirmed Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Is-Admin-Project: True Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Id: default Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Domain-Name: Default Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Project-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Role: member,reader Aug 10 12:43:56.273705 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Roles: member,reader Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f63c30b5d2af4144b096b78c7ab308a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f63c30b5d2af4144b096b78c7ab308a7"}]}] Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Id: f63c30b5d2af4144b096b78c7ab308a7 Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-Tenant-Name: tempest-TestVolumeBootPattern-452380591 Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Id: default Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Domain-Name: Default Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Id: 770127af5f494b7e9198438441868fa1 Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: X-User-Name: tempest-TestVolumeBootPattern-452380591-project Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: method: > Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: exception: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.275338 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: action_args: {'id': '461c4836-f025-459c-9295-0a840e0e2066'} Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: {{(pid=118381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:43:56.276244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. Aug 10 12:43:56.278400 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: ERROR nova.api.openstack.wsgi Aug 10 12:43:56.279768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: DEBUG nova.api.openstack.wsgi [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Returning 404 to user: Instance 461c4836-f025-459c-9295-0a840e0e2066 could not be found. {{(pid=118381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:43:56.279768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO nova.api.openstack.requestlog [None req-8fe9a9dc-bbf6-44d9-b9ef-2aebcf68908f tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066" status: 404 len: 111 microversion: 2.1 time: 0.029903 Aug 10 12:43:56.279768 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: [pid: 118381|app: 0|req: 558/1131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:56 2022] GET /compute/v2.1/servers/461c4836-f025-459c-9295-0a840e0e2066 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:43:57.562833 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: DEBUG nova.api.openstack.wsgi [None req-48753582-68c0-4bbf-89a6-83be54ce0b77 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] Calling method '.version_select at 0x7fcb98029c10>' {{(pid=118379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:57.587260 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO nova.api.openstack.requestlog [None req-48753582-68c0-4bbf-89a6-83be54ce0b77 tempest-TestVolumeBootPattern-452380591 tempest-TestVolumeBootPattern-452380591-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1160807107" status: 202 len: 0 microversion: 2.1 time: 0.028265 Aug 10 12:43:57.588315 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: [pid: 118379|app: 0|req: 574/1132] 10.222.0.65 () {58 vars in 1263 bytes} [Wed Aug 10 12:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1160807107 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:44:39.090321 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:44:39.090829 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Wed Aug 10 12:44:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:44:40.354756 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:44:40.355263 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Wed Aug 10 12:44:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:46:16.561519 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:46:16.562438 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Wed Aug 10 12:46:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:46:40.469748 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:46:40.470244 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Wed Aug 10 12:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:47:59.099978 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:47:59.100541 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Wed Aug 10 12:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:48:00.362802 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:48:00.363336 dv-cinder-852261-3-iscsi devstack@n-api.service[118379]: Wed Aug 10 12:48:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:48:16.975041 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:48:16.975562 dv-cinder-852261-3-iscsi devstack@n-api.service[118381]: Wed Aug 10 12:48:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!